Apr 24 19:06:35 devstack cinder-volume[72372]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:06:35 devstack cinder-volume[72372]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:06:35 devstack cinder-volume[72372]: we strongly recommend against using it for new projects. Apr 24 19:06:35 devstack cinder-volume[72372]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:06:35 devstack cinder-volume[72372]: framework. For more detail see Apr 24 19:06:35 devstack cinder-volume[72372]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:06:35 devstack cinder-volume[72372]: import eventlet # noqa Apr 24 19:06:37 devstack cinder-volume[72372]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:06:37 devstack cinder-volume[72372]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:06:37 devstack cinder-volume[72372]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:06:37 devstack cinder-volume[72372]: INFO dbcounter [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Registered counter for database cinder Apr 24 19:06:37 devstack cinder-volume[72372]: DEBUG oslo_db.sqlalchemy.engines [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72372) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG dbcounter [-] [72372] Writer thread running {{(pid=72372) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:06:38 devstack cinder-volume[72372]: INFO cinder.rpc [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:06:38 devstack cinder-volume[72372]: INFO cinder.rpc [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_db.sqlalchemy.engines [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72372) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:06:38 devstack cinder-volume[72372]: INFO cinder.volume.manager [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Determined volume DB was empty at startup. Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG cinder.volume.manager [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72372) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:06:38 devstack cinder-volume[72372]: INFO cinder.volume.manager [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 19:06:38 devstack cinder-volume[72372]: WARNING stevedore.named [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:06:38 devstack cinder-volume[72372]: WARNING castellan.key_manager [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:06:38 devstack cinder-volume[72372]: WARNING cinder.keymgr.conf_key_mgr [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG cinder.volume.drivers.lvm [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72372) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_concurrency.processutils [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_concurrency.processutils [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] CMD "cinder-rtstool verify" returned: 0 in 0.312s {{(pid=72372) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_db.sqlalchemy.engines [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72372) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:06:38 devstack cinder-volume[72372]: INFO cinder.rpc [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 24 19:06:38 devstack cinder-volume[72372]: INFO cinder.rpc [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 24 19:06:38 devstack cinder-volume[72372]: WARNING stevedore.named [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:06:38 devstack cinder-volume[72372]: WARNING castellan.key_manager [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:06:38 devstack cinder-volume[72372]: INFO cinder.volume.manager [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_db.sqlalchemy.engines [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72372) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:06:38 devstack cinder-volume[72372]: INFO oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Starting 1 workers Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Started child 72487 {{(pid=72372) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Full set of CONF: {{(pid=72372) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] ******************************************************************************** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Configuration options gathered from: {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] ================================================================================ {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:06:38 devstack cinder-volume[72487]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] allow_availability_zone_fallback = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] allow_compression_on_image_upload = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] allowed_direct_url_schemes = [] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] api_rate_limit = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] auth_strategy = keystone {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] az_cache_duration = 3600 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_availability_zone = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_host = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_name = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_stats_polling_interval = 60 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backup_api_class = cinder.backup.api.API {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backup_name_template = backup-%s {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backup_use_same_host = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backup_use_temp_snapshot = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] chap_password = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] chap_username = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cinder_internal_tenant_project_id = 2dfbb205e32f4c538857fad0eadbb16e {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cinder_internal_tenant_user_id = 247e53871c484d5e8074e91b5c8b2029 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cloned_volume_same_az = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cluster = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] compression_format = gzip {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] compute_api_class = cinder.compute.nova.API {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] config_dir = [] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] config_source = [] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] control_exchange = openstack {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] debug = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] default_availability_zone = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] default_group_type = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] default_volume_type = lvmdriver-1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] disk_geometry = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] driver_client_cert = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] driver_client_cert_key = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] driver_data_namespace = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] driver_ssl_cert_path = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] driver_ssl_cert_verify = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] driver_use_ssl = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] enable_force_upload = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] enable_new_services = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] enable_unsupported_driver = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] enforce_multipath_for_image_xfer = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] filter_function = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance_api_insecure = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance_api_servers = ['http://192.168.122.55/image'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance_api_ssl_compression = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance_ca_certificates_file = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance_catalog_info = image:glance:publicURL {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance_certfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance_keyfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance_num_retries = 3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance_request_timeout = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] goodness_function = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] graceful_shutdown_timeout = 5 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] group_api_class = cinder.group.api.API {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] host = devstack {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] image_compress_on_upload = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] image_conversion_address_space_limit = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] image_conversion_cpu_limit = 60 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] image_conversion_disable = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] image_upload_use_cinder_backend = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] image_upload_use_internal_tenant = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] image_volume_cache_enabled = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] image_volume_cache_max_count = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] image_volume_cache_max_size_gb = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] init_host_max_objects_retrieval = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] instance_format = [instance: %(uuid)s] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] iscsi_target_flags = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] iscsi_write_cache = on {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] iser_helper = tgtadm {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] iser_ip_address = 192.168.122.55 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] iser_port = 3260 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] log_color = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] log_config_append = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] log_dir = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] log_file = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] log_options = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] log_rotate_interval = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] log_rotate_interval_type = days {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] log_rotation_type = none {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] max_age = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] max_logfile_count = 30 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] max_logfile_size_mb = 200 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] max_over_subscription_ratio = 20.0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] message_reap_interval = 86400 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] message_ttl = 2592000 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] migration_create_volume_timeout_secs = 300 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] monkey_patch = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] monkey_patch_modules = [] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] my_ip = 192.168.122.55 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] no_snapshot_gb_quota = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] num_iser_scan_tries = 3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] num_shell_tries = 3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] num_volume_device_scan_tries = 3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] nvmeof_conn_info_version = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] nvmet_ns_id = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] nvmet_port_id = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] osapi_max_limit = 1000 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] osapi_volume_ext_list = [] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] osapi_volume_listen_port = 8776 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] osapi_volume_use_ssl = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] osapi_volume_workers = 2 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72487]: INFO cinder.volume.manager [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] per_volume_size_limit = -1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] periodic_fuzzy_delay = 60 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] periodic_interval = 60 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] public_endpoint = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] publish_errors = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] quota_backup_gigabytes = 1000 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] quota_backups = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] quota_gigabytes = 1000 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] quota_groups = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] quota_snapshots = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] quota_volumes = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] rate_limit_burst = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] rate_limit_except_level = CRITICAL {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] rate_limit_interval = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] reinit_driver_count = 3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] replication_device = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] report_discard_supported = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] report_interval = 120 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] reservation_clean_interval = 86400 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] reservation_expire = 86400 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] reserved_image_namespaces = [] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] reserved_percentage = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] rpc_response_timeout = 120 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] run_external_periodic_tasks = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] scst_target_driver = iscsi {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] scst_target_iqn_name = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] service_down_time = 720 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] shell_completion = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] snapshot_name_template = snapshot-%s {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] snapshot_same_host = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] split_loggers = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] state_path = /opt/stack/data/cinder {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] storage_availability_zone = nova {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] storage_protocol = iSCSI {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] syslog_log_facility = LOG_USER {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] target_helper = lioadm {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] target_ip_address = 192.168.122.55 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] target_port = 3260 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] target_protocol = iscsi {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] target_secondary_ip_addresses = [] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] trace_flags = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] transport_url = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] until_refresh = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] use_chap_auth = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] use_default_quota_class = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] use_journal = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] use_json = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] use_multipath_for_image_xfer = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] use_stderr = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] use_syslog = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] verify_glance_signatures = enabled {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_api_class = cinder.volume.api.API {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_backend_name = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_clear = zero {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_clear_ionice = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_clear_size = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_copy_bps_limit = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_dd_blocksize = 1M {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_name_template = volume-%s {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_service_inithost_offload = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volume_usage_audit_period = month {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] zoning_mode = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_concurrency.disable_process_locking = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.admin_password = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.admin_token = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.admin_user = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.auth_port = 35357 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.auth_protocol = https {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.auth_section = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.auth_type = password {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.auth_uri = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.auth_version = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.cache = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.certfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.identity_uri = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.include_service_catalog = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.insecure = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.interface = public {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.keyfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_password = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcache_username = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.region_name = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.service_type = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.55/identity {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.backend = dogpile.cache.null {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.backend_argument = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.backend_expiration_time = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.config_prefix = cache.oslo {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.debug_cache_backend = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.enable_retry_client = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.enable_socket_keepalive = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.enabled = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.enforce_fips_mode = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.expiration_time = 600 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.hashclient_retry_attempts = 2 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.memcache_dead_retry = 300 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.memcache_pool_maxsize = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.memcache_sasl_enabled = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.password = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.proxies = [] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.redis_db = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.redis_server = localhost:6379 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.retry_attempts = 2 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.retry_delay = 0.0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.socket_keepalive_count = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.socket_keepalive_idle = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.socket_keepalive_interval = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.socket_timeout = 1.0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.tls_allowed_ciphers = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.tls_cafile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.tls_certfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.tls_enabled = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.tls_keyfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cache.username = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] coordination.backend_url = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.asyncio_connection = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.asyncio_slave_connection = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.backend = sqlalchemy {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.connection = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.connection_debug = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.connection_parameters = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.connection_recycle_time = 3600 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.connection_trace = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.db_inc_retry_interval = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.db_max_retries = 20 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.db_max_retry_interval = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.db_retry_interval = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.max_overflow = 50 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.max_pool_size = 5 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.max_retries = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.mysql_wsrep_sync_wait = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.pool_timeout = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.retry_interval = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.slave_connection = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.sqlite_synchronous = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.synchronous_reader = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] database.use_db_reconnect = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler.connection_string = messaging:// {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler.enabled = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler.es_doc_type = notification {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler.es_scroll_size = 10000 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler.es_scroll_time = 2m {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler.filter_error_trace = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler.hmac_keys = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler.sentinel_service_name = mymaster {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler.socket_timeout = 0.1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler.trace_requests = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler.trace_sqlalchemy = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler_jaeger.process_tags = {} {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler_jaeger.service_name_prefix = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] profiler_otlp.service_name_prefix = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_policy.enforce_new_defaults = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: WARNING oslo_config.cfg [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_policy.enforce_scope = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_policy.policy_default_rule = default {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_policy.policy_file = policy.yaml {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] privsep_osbrick.group = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] privsep_osbrick.helper_command = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] privsep_osbrick.user = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cinder_sys_admin.group = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cinder_sys_admin.helper_command = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] cinder_sys_admin.user = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] service_user.auth_section = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] service_user.auth_type = password {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] service_user.cafile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] service_user.certfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] service_user.collect_timing = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] service_user.insecure = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] service_user.keyfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] service_user.send_service_user_token = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] service_user.split_loggers = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] service_user.timeout = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance.auth_section = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance.auth_type = password {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance.certfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance.collect_timing = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance.insecure = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance.keyfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance.region_name = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance.split_loggers = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] glance.timeout = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.backend_availability_zone = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.chap_password = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.chap_username = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.disk_geometry = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.driver_client_cert = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.driver_client_cert_key = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.driver_data_namespace = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.driver_use_ssl = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.extra_capabilities = {} {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.filter_function = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.goodness_function = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.iscsi_target_flags = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.iscsi_write_cache = on {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.iser_helper = tgtadm {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.iser_ip_address = 192.168.122.55 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.iser_port = 3260 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.lvm_share_target = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.lvm_type = auto {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.num_shell_tries = 3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.replication_device = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.report_discard_supported = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.reserved_percentage = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.target_helper = tgtadm {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.target_ip_address = 192.168.122.55 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.target_port = 3260 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.target_protocol = iscsi {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.trace_flags = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.unique_fqdn_network = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.use_chap_auth = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.volume_backend_name = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.volume_clear = zero {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.volume_clear_ionice = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.volume_clear_size = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_reports.file_event_handler = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_reports.log_dir = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.backend_host = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.chap_password = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.chap_username = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.disk_geometry = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.driver_client_cert = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.extra_capabilities = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.filter_function = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.goodness_function = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.iser_helper = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.iser_ip_address = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.iser_port = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.lvm_share_target = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.lvm_type = auto {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.num_shell_tries = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.replication_device = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.report_discard_supported = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.reserved_percentage = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.scst_target_driver = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.storage_protocol = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.target_helper = lioadm {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.target_ip_address = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.target_port = 3260 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.trace_flags = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.use_chap_auth = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.volume_clear = zero {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.volume_clear_size = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] lvmdriver-1.volumes_dir = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.ssl = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_notifications.driver = [] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_notifications.retry = -1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] key_manager.fixed_key = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.barbican_api_version = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.barbican_endpoint = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.barbican_endpoint_type = public {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.barbican_region_name = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.cafile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.certfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.collect_timing = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.insecure = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.keyfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.number_of_retries = 60 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.retry_delay = 1 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.send_service_user_token = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.split_loggers = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.timeout = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.verify_ssl = True {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican.verify_ssl_path = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican_service_user.auth_section = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican_service_user.auth_type = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican_service_user.cafile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican_service_user.certfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican_service_user.collect_timing = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican_service_user.insecure = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican_service_user.keyfile = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican_service_user.split_loggers = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] barbican_service_user.timeout = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vault.approle_role_id = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vault.approle_secret_id = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vault.kv_mountpoint = secret {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vault.kv_path = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vault.kv_version = 2 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vault.namespace = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vault.root_token_id = **** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vault.ssl_ca_crt_file = None {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vault.timeout = 60.0 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vault.use_ssl = False {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:06:38 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] ******************************************************************************** {{(pid=72372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:06:38 devstack sudo[72494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 24 19:06:38 devstack sudo[72494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:39 devstack sudo[72494]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:39 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.548s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:39 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:39 devstack sudo[72712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:06:39 devstack sudo[72712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:40 devstack sudo[72712]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:40 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.549s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:40 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:06:40 devstack cinder-volume[72487]: INFO cinder.brick.local_dev.lvm [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 24 19:06:40 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:40 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:40 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:40 devstack sudo[72900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:06:40 devstack sudo[72900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:40 devstack sudo[72900]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:40 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:40 devstack cinder-volume[72487]: DEBUG cinder.brick.local_dev.lvm [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72487) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 24 19:06:40 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:40 devstack sudo[73008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:06:40 devstack sudo[73008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:41 devstack sudo[73008]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:41 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.947s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:41 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:41 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:41 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:41 devstack sudo[73172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:06:41 devstack sudo[73172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:42 devstack sudo[73172]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:42 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.585s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:42 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:42 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:42 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:42 devstack sudo[73176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 24 19:06:42 devstack sudo[73176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:42 devstack sudo[73176]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:42 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.583s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:42 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:42 devstack sudo[73179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:06:42 devstack sudo[73179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:43 devstack sudo[73179]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:43 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.566s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:43 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:43 devstack sudo[73187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:06:43 devstack sudo[73187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:43 devstack sudo[73187]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:43 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.543s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:43 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:43 devstack sudo[73192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:06:43 devstack sudo[73192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:44 devstack sudo[73192]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:44 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.541s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:44 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:44 devstack sudo[73195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:06:44 devstack sudo[73195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:45 devstack sudo[73195]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:45 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.565s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:45 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:45 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:45 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:45 devstack sudo[73204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:06:45 devstack sudo[73204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:45 devstack sudo[73204]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:45 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.590s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:45 devstack cinder-volume[72487]: INFO cinder.volume.drivers.lvm [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 24 19:06:45 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:45 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:45 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:45 devstack sudo[73321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:06:45 devstack sudo[73321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:46 devstack sudo[73321]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:46 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:46 devstack cinder-volume[72487]: DEBUG cinder.volume.drivers.lvm [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Updating volume stats {{(pid=72487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:06:46 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:46 devstack sudo[73449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:06:46 devstack sudo[73449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:46 devstack sudo[73449]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:46 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:46 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:46 devstack sudo[73465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:06:46 devstack sudo[73465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:47 devstack sudo[73465]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:47 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.516s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:47 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:47 devstack sudo[73468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:06:47 devstack sudo[73468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:47 devstack sudo[73468]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:47 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.490s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:47 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:47 devstack sudo[73471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:06:47 devstack sudo[73471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:48 devstack sudo[73471]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:48 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.542s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:48 devstack cinder-volume[72487]: INFO cinder.volume.driver [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:06:48 devstack cinder-volume[72487]: DEBUG cinder.volume.driver [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72487) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:06:48 devstack cinder-volume[72487]: DEBUG oslo_db.sqlalchemy.engines [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:06:48 devstack cinder-volume[72487]: DEBUG dbcounter [-] [72487] Writer thread running {{(pid=72487) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:06:48 devstack cinder-volume[72487]: DEBUG cinder.db.sqlalchemy.api [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Building query based on filter {{(pid=72487) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:06:48 devstack cinder-volume[72487]: DEBUG cinder.image.image_utils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72487) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:06:48 devstack cinder-volume[72487]: INFO cinder.keymgr.migration [None req-f7cd92b4-11c6-41b9-a088-a84ed15810b4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:06:48 devstack cinder-volume[72487]: DEBUG cinder.volume.drivers.lvm [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Updating volume stats {{(pid=72487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:06:48 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:48 devstack sudo[73481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:06:48 devstack sudo[73481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:48 devstack cinder-volume[72372]: DEBUG dbcounter [-] [72372] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72372) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:06:48 devstack sudo[73481]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:48 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:48 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:48 devstack sudo[73486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:06:48 devstack sudo[73486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:49 devstack sudo[73486]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:49 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.543s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:49 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:49 devstack sudo[73490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:06:49 devstack sudo[73490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:49 devstack sudo[73490]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:49 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.544s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:49 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:49 devstack sudo[73496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:06:49 devstack sudo[73496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:50 devstack sudo[73496]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:50 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.537s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:50 devstack cinder-volume[72487]: DEBUG cinder.manager [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Notifying Schedulers of capabilities ... {{(pid=72487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:06:50 devstack cinder-volume[72487]: INFO cinder.volume.manager [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Driver initialization completed successfully. Apr 24 19:06:50 devstack cinder-volume[72487]: INFO cinder.manager [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Initiating service 2 cleanup Apr 24 19:06:50 devstack cinder-volume[72487]: INFO cinder.manager [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Service 2 cleanup completed. Apr 24 19:06:50 devstack cinder-volume[72487]: DEBUG cinder.service [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Creating RPC server for service cinder-volume {{(pid=72487) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:06:50 devstack cinder-volume[72487]: DEBUG cinder.service [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72487) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:06:50 devstack cinder-volume[72487]: INFO cinder.volume.manager [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 24 19:06:50 devstack cinder-volume[72487]: DEBUG cinder.volume.drivers.lvm [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Updating volume stats {{(pid=72487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:06:50 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:50 devstack sudo[73500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:06:50 devstack sudo[73500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:51 devstack sudo[73500]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:51 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:51 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:51 devstack sudo[73503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:06:51 devstack sudo[73503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:51 devstack sudo[73503]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:51 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:51 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:51 devstack sudo[73560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:06:51 devstack sudo[73560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:52 devstack sudo[73560]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:52 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:52 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:06:52 devstack sudo[73591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:06:52 devstack sudo[73591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:06:52 devstack sudo[73591]: pam_unix(sudo:session): session closed for user root Apr 24 19:06:52 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:06:52 devstack cinder-volume[72487]: INFO cinder.volume.manager [None req-735da991-8eef-4c4b-a15e-eb66892ca1b5 None None] Driver post RPC initialization completed successfully. Apr 24 19:07:02 devstack cinder-volume[72487]: DEBUG dbcounter [-] [72487] Writing DB stats cinder:SELECT=3 {{(pid=72487) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:07:02 devstack cinder-volume[72487]: DEBUG dbcounter [-] [72487] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72487) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:08:29 devstack cinder-volume[72487]: DEBUG oslo_service.periodic_task [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72487) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:08:29 devstack cinder-volume[72487]: DEBUG cinder.volume.drivers.lvm [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Updating volume stats {{(pid=72487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:08:29 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:29 devstack sudo[78579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:08:29 devstack sudo[78579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:30 devstack sudo[78579]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.540s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:30 devstack sudo[78586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:08:30 devstack sudo[78586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:30 devstack sudo[78586]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.544s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:30 devstack sudo[78590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:08:30 devstack sudo[78590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:31 devstack sudo[78590]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:31 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.481s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:31 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:08:31 devstack sudo[78593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:08:31 devstack sudo[78593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:08:31 devstack sudo[78593]: pam_unix(sudo:session): session closed for user root Apr 24 19:08:31 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:08:31 devstack cinder-volume[72487]: DEBUG cinder.manager [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Notifying Schedulers of capabilities ... {{(pid=72487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:09:02 devstack cinder-volume[72487]: DEBUG dbcounter [-] [72487] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72487) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:09:29 devstack cinder-volume[72487]: DEBUG oslo_service.periodic_task [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72487) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:09:29 devstack cinder-volume[72487]: DEBUG cinder.volume.drivers.lvm [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Updating volume stats {{(pid=72487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:09:29 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:29 devstack sudo[80326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:09:29 devstack sudo[80326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:30 devstack sudo[80326]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:30 devstack sudo[80329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:09:30 devstack sudo[80329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:30 devstack sudo[80329]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.501s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:30 devstack sudo[80355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:09:30 devstack sudo[80355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:31 devstack sudo[80355]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:31 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.521s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:31 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:09:31 devstack sudo[80362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:09:31 devstack sudo[80362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:09:31 devstack sudo[80362]: pam_unix(sudo:session): session closed for user root Apr 24 19:09:31 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:09:31 devstack cinder-volume[72487]: DEBUG cinder.manager [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Notifying Schedulers of capabilities ... {{(pid=72487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:10:29 devstack cinder-volume[72487]: DEBUG oslo_service.periodic_task [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72487) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:10:29 devstack cinder-volume[72487]: DEBUG cinder.volume.drivers.lvm [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Updating volume stats {{(pid=72487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 19:10:29 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:29 devstack sudo[81177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 19:10:29 devstack sudo[81177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:10:30 devstack sudo[81177]: pam_unix(sudo:session): session closed for user root Apr 24 19:10:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:30 devstack sudo[81192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:10:30 devstack sudo[81192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:10:30 devstack sudo[81192]: pam_unix(sudo:session): session closed for user root Apr 24 19:10:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:30 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:30 devstack sudo[81196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 19:10:30 devstack sudo[81196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:10:31 devstack sudo[81196]: pam_unix(sudo:session): session closed for user root Apr 24 19:10:31 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.515s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:31 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:31 devstack sudo[81214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 19:10:31 devstack sudo[81214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:10:31 devstack sudo[81214]: pam_unix(sudo:session): session closed for user root Apr 24 19:10:31 devstack cinder-volume[72487]: DEBUG oslo_concurrency.processutils [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.511s {{(pid=72487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:31 devstack cinder-volume[72487]: DEBUG cinder.manager [None req-232d673a-0cb4-479d-adac-38ef8fa22d5d None None] Notifying Schedulers of capabilities ... {{(pid=72487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:10:35 devstack cinder-volume[72372]: INFO oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Caught SIGTERM, stopping children Apr 24 19:10:35 devstack cinder-volume[72372]: DEBUG oslo_concurrency.lockutils [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Acquiring lock "singleton_lock" {{(pid=72372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:10:35 devstack cinder-volume[72372]: DEBUG oslo_concurrency.lockutils [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Acquired lock "singleton_lock" {{(pid=72372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:10:35 devstack cinder-volume[72372]: DEBUG oslo_concurrency.lockutils [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Releasing lock "singleton_lock" {{(pid=72372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:10:35 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Stop services. {{(pid=72372) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 19:10:35 devstack cinder-volume[72372]: DEBUG oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Killing children. {{(pid=72372) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 19:10:35 devstack cinder-volume[72372]: INFO oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Waiting on 1 children to exit Apr 24 19:10:40 devstack cinder-volume[72487]: DEBUG oslo_concurrency.lockutils [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Acquiring lock "singleton_lock" {{(pid=72487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:10:40 devstack cinder-volume[72487]: DEBUG oslo_concurrency.lockutils [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Acquired lock "singleton_lock" {{(pid=72487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:10:40 devstack cinder-volume[72487]: DEBUG oslo_concurrency.lockutils [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Releasing lock "singleton_lock" {{(pid=72487) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:10:40 devstack cinder-volume[72487]: WARNING amqp [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:10:40 devstack cinder-volume[72487]: WARNING amqp [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:10:40 devstack cinder-volume[72372]: INFO oslo_service.backend._eventlet.service [None req-759b98ef-d823-4cc3-bb59-ef7f14253995 None None] Child 72487 exited with status 0 Apr 24 19:10:40 devstack cinder-volume[81456]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:10:40 devstack cinder-volume[81456]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:10:40 devstack cinder-volume[81456]: we strongly recommend against using it for new projects. Apr 24 19:10:40 devstack cinder-volume[81456]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:10:40 devstack cinder-volume[81456]: framework. For more detail see Apr 24 19:10:40 devstack cinder-volume[81456]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:10:40 devstack cinder-volume[81456]: import eventlet # noqa Apr 24 19:10:43 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:10:43 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:10:43 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:10:43 devstack cinder-volume[81456]: INFO dbcounter [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Registered counter for database cinder Apr 24 19:10:43 devstack cinder-volume[81456]: DEBUG oslo_db.sqlalchemy.engines [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81456) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG dbcounter [-] [81456] Writer thread running {{(pid=81456) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:10:44 devstack cinder-volume[81456]: INFO cinder.rpc [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:10:44 devstack cinder-volume[81456]: INFO cinder.rpc [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_db.sqlalchemy.engines [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81456) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:10:44 devstack cinder-volume[81456]: INFO cinder.volume.manager [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Determined volume DB was empty at startup. Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG cinder.volume.manager [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81456) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:10:44 devstack cinder-volume[81456]: INFO cinder.volume.manager [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 19:10:44 devstack cinder-volume[81456]: WARNING stevedore.named [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:10:44 devstack cinder-volume[81456]: WARNING castellan.key_manager [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:10:44 devstack cinder-volume[81456]: WARNING cinder.keymgr.conf_key_mgr [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:10:44 devstack cinder-volume[81456]: INFO cinder.volume.manager [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_db.sqlalchemy.engines [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81456) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:10:44 devstack cinder-volume[81456]: INFO oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Starting 1 workers Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Started child 81576 {{(pid=81456) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Full set of CONF: {{(pid=81456) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] ******************************************************************************** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Configuration options gathered from: {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:10:44 devstack cinder-volume[81576]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] ================================================================================ {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] allow_availability_zone_fallback = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] allow_compression_on_image_upload = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] allowed_direct_url_schemes = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] api_rate_limit = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] auth_strategy = keystone {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_availability_zone = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_host = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_stats_polling_interval = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backup_api_class = cinder.backup.api.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backup_name_template = backup-%s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backup_use_same_host = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backup_use_temp_snapshot = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] chap_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] chap_username = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cinder_internal_tenant_project_id = 2dfbb205e32f4c538857fad0eadbb16e {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cinder_internal_tenant_user_id = 247e53871c484d5e8074e91b5c8b2029 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cluster = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] compression_format = gzip {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] compute_api_class = cinder.compute.nova.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] config_dir = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] config_source = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] control_exchange = openstack {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] debug = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] default_availability_zone = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] default_group_type = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81576]: INFO cinder.volume.manager [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 19:10:44 devstack cinder-volume[81576]: DEBUG cinder.volume.drivers.remotefs [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81576) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] default_volume_type = QuobyteHD {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] disk_geometry = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] driver_client_cert = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] driver_client_cert_key = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] driver_data_namespace = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] driver_ssl_cert_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] driver_ssl_cert_verify = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] driver_use_ssl = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] enable_new_services = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] enable_unsupported_driver = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] enabled_backends = ['QuobyteHD'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] enforce_multipath_for_image_xfer = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] filter_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance_api_insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance_api_servers = ['http://192.168.122.55/image'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance_api_ssl_compression = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance_ca_certificates_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance_catalog_info = image:glance:publicURL {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance_certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance_keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance_num_retries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance_request_timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] goodness_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] graceful_shutdown_timeout = 5 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] group_api_class = cinder.group.api.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] host = devstack {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] image_compress_on_upload = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] image_conversion_address_space_limit = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] image_conversion_cpu_limit = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] image_conversion_disable = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] image_upload_use_cinder_backend = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] image_upload_use_internal_tenant = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] image_volume_cache_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] image_volume_cache_max_count = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] image_volume_cache_max_size_gb = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] init_host_max_objects_retrieval = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] instance_format = [instance: %(uuid)s] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] iscsi_target_flags = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] iscsi_write_cache = on {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] iser_helper = tgtadm {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] iser_ip_address = 192.168.122.55 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] iser_port = 3260 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] log_color = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] log_config_append = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] log_dir = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] log_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] log_options = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] log_rotate_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] log_rotate_interval_type = days {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] log_rotation_type = none {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] max_age = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] max_logfile_count = 30 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] max_logfile_size_mb = 200 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] max_over_subscription_ratio = 20.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] message_reap_interval = 86400 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] message_ttl = 2592000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] migration_create_volume_timeout_secs = 300 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] monkey_patch = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] monkey_patch_modules = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] my_ip = 192.168.122.55 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] no_snapshot_gb_quota = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] num_iser_scan_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] num_shell_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] num_volume_device_scan_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] nvmeof_conn_info_version = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] nvmet_ns_id = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] nvmet_port_id = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] osapi_max_limit = 1000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] osapi_volume_ext_list = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] osapi_volume_listen = 0.0.0.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] osapi_volume_listen_port = 8776 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] osapi_volume_use_ssl = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] osapi_volume_workers = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] per_volume_size_limit = -1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] periodic_fuzzy_delay = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81576]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81576) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 19:10:44 devstack cinder-volume[81576]: WARNING cinder.volume.drivers.quobyte [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 19:10:44 devstack cinder-volume[81576]: WARNING cinder.volume.drivers.quobyte [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] periodic_interval = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] project_id_regex = [0-9a-f\-]+ {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] public_endpoint = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] publish_errors = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] quota_backup_gigabytes = 1000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Running cmd (subprocess): mount.quobyte {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] quota_backups = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] quota_gigabytes = 1000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] quota_groups = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] quota_snapshots = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] quota_volumes = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] rate_limit_burst = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] rate_limit_except_level = CRITICAL {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] rate_limit_interval = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] reinit_driver_count = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] replication_device = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] report_discard_supported = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] report_interval = 120 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] reservation_clean_interval = 86400 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] reservation_expire = 86400 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] reserved_image_namespaces = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] reserved_percentage = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] rpc_response_timeout = 120 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] run_external_periodic_tasks = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] scst_target_driver = iscsi {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] scst_target_iqn_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] service_down_time = 720 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] shell_completion = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] snapshot_name_template = snapshot-%s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] split_loggers = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] state_path = /opt/stack/data/cinder {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] storage_availability_zone = nova {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] storage_protocol = iSCSI {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] syslog_log_facility = LOG_USER {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] target_helper = lioadm {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] target_ip_address = 192.168.122.55 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] target_port = 3260 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] target_protocol = iscsi {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] target_secondary_ip_addresses = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] trace_flags = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] transfer_api_class = cinder.transfer.api.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] transport_url = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] until_refresh = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] use_chap_auth = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] use_default_quota_class = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] use_journal = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] use_json = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] use_multipath_for_image_xfer = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] use_stderr = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] use_syslog = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] verify_glance_signatures = enabled {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_api_class = cinder.volume.api.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_backend_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_clear = zero {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_clear_ionice = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_clear_size = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_copy_bps_limit = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_dd_blocksize = 1M {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_name_template = volume-%s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_service_inithost_offload = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volume_usage_audit_period = month {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] zoning_mode = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_concurrency.disable_process_locking = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.admin_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.admin_token = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.admin_user = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.auth_admin_prefix = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.auth_port = 35357 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.auth_protocol = https {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.auth_section = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.auth_type = password {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.auth_uri = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.auth_version = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.cache = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.delay_auth_decision = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.http_connect_timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.identity_uri = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.include_service_catalog = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.interface = public {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_password = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack quobyte-client[81577]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 19:10:44 devstack quobyte-client[81577]: Invalid parameters found, error: missing mount point. Apr 24 19:10:44 devstack quobyte-client[81577]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 19:10:44 devstack quobyte-client[81577]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcache_username = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.region_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.service_token_roles_required = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.service_type = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.token_cache_time = 300 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.55/identity {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.backend = dogpile.cache.null {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:10:44 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:10:44 devstack cinder-volume[81576]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=81576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.backend_argument = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81576]: INFO cinder.volume.drivers.quobyte [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 ... Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.backend_expiration_time = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc -c /etc/quobyte/client-cinder.cfg {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.config_prefix = cache.oslo {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.debug_cache_backend = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.enable_retry_client = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.enable_socket_keepalive = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.enforce_fips_mode = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.expiration_time = 600 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.hashclient_retry_attempts = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.memcache_dead_retry = 300 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.memcache_pool_maxsize = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.memcache_sasl_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.proxies = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.redis_db = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.redis_sentinel_service_name = mymaster {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.redis_server = localhost:6379 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.retry_attempts = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.retry_delay = 0.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack sudo[81578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc -c /etc/quobyte/client-cinder.cfg Apr 24 19:10:44 devstack sudo[81578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.socket_keepalive_count = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.socket_keepalive_idle = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.socket_keepalive_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.socket_timeout = 1.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.tls_allowed_ciphers = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.tls_cafile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.tls_certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.tls_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.tls_keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cache.username = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] coordination.backend_url = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.asyncio_connection = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.asyncio_slave_connection = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.backend = sqlalchemy {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.connection = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.connection_debug = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.connection_parameters = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.connection_recycle_time = 3600 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.connection_trace = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.db_inc_retry_interval = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.db_max_retries = 20 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.db_max_retry_interval = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.db_retry_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.max_overflow = 50 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.max_pool_size = 5 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.max_retries = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.mysql_wsrep_sync_wait = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.pool_timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.retry_interval = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.slave_connection = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.sqlite_synchronous = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.synchronous_reader = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] database.use_db_reconnect = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler.connection_string = messaging:// {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler.enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler.es_doc_type = notification {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler.es_scroll_size = 10000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler.es_scroll_time = 2m {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler.filter_error_trace = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler.hmac_keys = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler.sentinel_service_name = mymaster {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler.socket_timeout = 0.1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler.trace_requests = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler.trace_sqlalchemy = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler_jaeger.process_tags = {} {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler_jaeger.service_name_prefix = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] profiler_otlp.service_name_prefix = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_policy.enforce_new_defaults = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: WARNING oslo_config.cfg [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_policy.enforce_scope = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_policy.policy_default_rule = default {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_policy.policy_file = policy.yaml {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_policy.remote_timeout = 60.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] privsep_osbrick.group = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] privsep_osbrick.helper_command = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] privsep_osbrick.user = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cinder_sys_admin.group = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cinder_sys_admin.helper_command = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] cinder_sys_admin.user = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] service_user.auth_section = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] service_user.auth_type = password {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] service_user.cafile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] service_user.certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] service_user.collect_timing = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] service_user.insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] service_user.keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] service_user.send_service_user_token = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] service_user.split_loggers = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] service_user.timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance.auth_section = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance.auth_type = password {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance.certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance.collect_timing = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance.insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance.keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance.region_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance.split_loggers = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] glance.timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.backend_availability_zone = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.chap_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.chap_username = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.disk_geometry = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.driver_client_cert = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.driver_client_cert_key = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.driver_data_namespace = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.driver_use_ssl = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.enable_unsupported_driver = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.extra_capabilities = {} {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.filter_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.goodness_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.iscsi_target_flags = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.iscsi_write_cache = on {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.iser_helper = tgtadm {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.iser_ip_address = 192.168.122.55 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.iser_port = 3260 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nas_host = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nas_login = admin {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nas_mount_options = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nas_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nas_private_key = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nas_share_path = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nas_ssh_port = 22 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.num_shell_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.nvmet_port_id = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.quobyte_client_cfg = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.quobyte_volume_url = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.replication_device = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.report_discard_supported = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.reserved_percentage = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.scst_target_driver = iscsi {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.scst_target_iqn_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.storage_protocol = iSCSI {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.target_helper = tgtadm {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.target_ip_address = 192.168.122.55 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.target_port = 3260 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.target_protocol = iscsi {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.trace_flags = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.unique_fqdn_network = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.use_chap_auth = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.volume_backend_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.volume_clear = zero {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.volume_clear_ionice = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.volume_clear_size = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_reports.file_event_handler = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_reports.log_dir = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.backend_availability_zone = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.backend_host = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.chap_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.chap_username = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.chiscsi_conf = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.disk_geometry = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.driver_client_cert = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.driver_client_cert_key = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.driver_data_namespace = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.driver_use_ssl = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.extra_capabilities = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.filter_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.goodness_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.iscsi_target_flags = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.iscsi_write_cache = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.iser_helper = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.iser_ip_address = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.iser_port = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.iser_target_prefix = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nas_host = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nas_login = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nas_mount_options = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nas_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nas_private_key = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nas_share_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nas_ssh_port = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.num_shell_tries = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nvmet_ns_id = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.nvmet_port_id = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.replication_device = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.report_discard_supported = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.reserved_percentage = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.scst_target_driver = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.storage_protocol = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.target_helper = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.target_ip_address = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.target_port = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.target_prefix = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.target_protocol = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.trace_flags = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.unique_fqdn_network = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.use_chap_auth = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.volume_clear = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.volume_clear_ionice = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.volume_clear_size = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] QuobyteHD.volumes_dir = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.ssl = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.ssl_version = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_notifications.driver = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_notifications.retry = -1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] oslo_messaging_notifications.transport_url = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] key_manager.fixed_key = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.barbican_api_version = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.barbican_endpoint = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.barbican_endpoint_type = public {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.barbican_region_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.cafile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.collect_timing = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.number_of_retries = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.retry_delay = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.send_service_user_token = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.split_loggers = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.verify_ssl = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican.verify_ssl_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican_service_user.auth_section = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican_service_user.auth_type = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican_service_user.cafile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican_service_user.certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican_service_user.collect_timing = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican_service_user.insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican_service_user.keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican_service_user.split_loggers = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] barbican_service_user.timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vault.approle_role_id = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vault.approle_secret_id = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vault.kv_mountpoint = secret {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vault.kv_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vault.kv_version = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vault.namespace = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vault.root_token_id = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vault.ssl_ca_crt_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vault.timeout = 60.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vault.use_ssl = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:44 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] ******************************************************************************** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:10:45 devstack sudo[81578]: pam_unix(sudo:session): session closed for user root Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.663s {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:45 devstack cinder-volume[81576]: INFO cinder.volume.drivers.quobyte [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 succeeded Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=81576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.674s {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:45 devstack sudo[81647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:10:45 devstack sudo[81647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:10:45 devstack sudo[81647]: pam_unix(sudo:session): session closed for user root Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.538s {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:45 devstack cinder-volume[81576]: INFO cinder.volume.driver [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG cinder.volume.driver [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309684753418, 'free_capacity_gb': 1775.7309684753418, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81576) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG oslo_db.sqlalchemy.engines [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81576) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG dbcounter [-] [81576] Writer thread running {{(pid=81576) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG cinder.db.sqlalchemy.api [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Building query based on filter {{(pid=81576) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG cinder.image.image_utils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81576) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:10:45 devstack cinder-volume[81576]: INFO cinder.keymgr.migration [None req-e0c7684d-bd7c-4305-8681-6314dbfa95ca None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=81576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=81576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:10:45 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:45 devstack sudo[81675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:10:45 devstack sudo[81675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:10:46 devstack sudo[81675]: pam_unix(sudo:session): session closed for user root Apr 24 19:10:46 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.850s {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:46 devstack cinder-volume[81576]: DEBUG cinder.manager [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Notifying Schedulers of capabilities ... {{(pid=81576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:10:46 devstack cinder-volume[81576]: INFO cinder.volume.manager [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Driver initialization completed successfully. Apr 24 19:10:46 devstack cinder-volume[81576]: INFO cinder.manager [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Initiating service 3 cleanup Apr 24 19:10:46 devstack cinder-volume[81576]: INFO cinder.manager [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Service 3 cleanup completed. Apr 24 19:10:46 devstack cinder-volume[81576]: DEBUG cinder.service [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Creating RPC server for service cinder-volume {{(pid=81576) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:10:46 devstack cinder-volume[81576]: DEBUG cinder.service [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81576) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:10:46 devstack cinder-volume[81576]: INFO cinder.volume.manager [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 19:10:46 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:10:46 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:10:46 devstack cinder-volume[81576]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=81576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:10:46 devstack cinder-volume[81576]: DEBUG cinder.volume.drivers.quobyte [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=81576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:10:46 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:10:46 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:46 devstack sudo[81715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:10:46 devstack sudo[81715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:10:47 devstack sudo[81715]: pam_unix(sudo:session): session closed for user root Apr 24 19:10:47 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.460s {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:47 devstack cinder-volume[81576]: INFO cinder.volume.manager [None req-c3e2fd21-9e18-4b69-82c1-2ce5495e984f None None] Driver post RPC initialization completed successfully. Apr 24 19:10:49 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-9d11e707-bf55-4417-8dea-2dcc6aa02d31 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:10:49 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-9d11e707-bf55-4417-8dea-2dcc6aa02d31 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:10:49 devstack cinder-volume[81576]: DEBUG cinder.volume.drivers.quobyte [None req-9d11e707-bf55-4417-8dea-2dcc6aa02d31 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=81576) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:10:49 devstack cinder-volume[81576]: DEBUG cinder.volume.drivers.quobyte [None req-9d11e707-bf55-4417-8dea-2dcc6aa02d31 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=81576) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:10:49 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-9d11e707-bf55-4417-8dea-2dcc6aa02d31 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81576) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:10:49 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-9d11e707-bf55-4417-8dea-2dcc6aa02d31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:49 devstack sudo[81722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:10:49 devstack sudo[81722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:10:49 devstack sudo[81722]: pam_unix(sudo:session): session closed for user root Apr 24 19:10:49 devstack cinder-volume[81576]: DEBUG oslo_concurrency.processutils [None req-9d11e707-bf55-4417-8dea-2dcc6aa02d31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.432s {{(pid=81576) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:49 devstack cinder-volume[81576]: DEBUG cinder.manager [None req-9d11e707-bf55-4417-8dea-2dcc6aa02d31 None None] Notifying Schedulers of capabilities ... {{(pid=81576) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:10:51 devstack cinder-volume[81456]: INFO oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Caught SIGTERM, stopping children Apr 24 19:10:51 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Acquiring lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:10:51 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Acquired lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:10:51 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Releasing lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:10:51 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Stop services. {{(pid=81456) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 19:10:51 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Killing children. {{(pid=81456) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 19:10:51 devstack cinder-volume[81456]: INFO oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Waiting on 1 children to exit Apr 24 19:10:55 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Acquiring lock "singleton_lock" {{(pid=81576) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:10:55 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Acquired lock "singleton_lock" {{(pid=81576) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:10:55 devstack cinder-volume[81576]: DEBUG oslo_concurrency.lockutils [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Releasing lock "singleton_lock" {{(pid=81576) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:10:55 devstack cinder-volume[81576]: WARNING amqp [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:10:55 devstack cinder-volume[81576]: WARNING amqp [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 19:10:55 devstack cinder-volume[81456]: INFO oslo_service.backend._eventlet.service [None req-3c0251da-5614-4cad-b5fb-b2c69f6ade0b None None] Child 81576 exited with status 0 Apr 24 19:10:55 devstack cinder-volume[81819]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 19:10:55 devstack cinder-volume[81819]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:10:55 devstack cinder-volume[81819]: we strongly recommend against using it for new projects. Apr 24 19:10:55 devstack cinder-volume[81819]: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:10:55 devstack cinder-volume[81819]: framework. For more detail see Apr 24 19:10:55 devstack cinder-volume[81819]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:10:55 devstack cinder-volume[81819]: import eventlet # noqa Apr 24 19:10:57 devstack cinder-volume[81819]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 19:10:57 devstack cinder-volume[81819]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 19:10:57 devstack cinder-volume[81819]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81819) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 19:10:58 devstack cinder-volume[81819]: INFO dbcounter [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Registered counter for database cinder Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_db.sqlalchemy.engines [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG dbcounter [-] [81819] Writer thread running {{(pid=81819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:10:58 devstack cinder-volume[81819]: INFO cinder.rpc [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 19:10:58 devstack cinder-volume[81819]: INFO cinder.rpc [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_db.sqlalchemy.engines [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:10:58 devstack cinder-volume[81819]: INFO cinder.volume.manager [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Determined volume DB was empty at startup. Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG cinder.volume.manager [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81819) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 19:10:58 devstack cinder-volume[81819]: WARNING stevedore.named [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 19:10:58 devstack cinder-volume[81819]: WARNING castellan.key_manager [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:10:58 devstack cinder-volume[81819]: WARNING cinder.keymgr.conf_key_mgr [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 19:10:58 devstack cinder-volume[81819]: INFO cinder.volume.manager [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_db.sqlalchemy.engines [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81819) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:10:58 devstack cinder-volume[81819]: INFO oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Starting 1 workers Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Started child 82057 {{(pid=81819) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Full set of CONF: {{(pid=81819) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] ******************************************************************************** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Configuration options gathered from: {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] ================================================================================ {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 19:10:58 devstack cinder-volume[82057]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] allow_availability_zone_fallback = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] allow_compression_on_image_upload = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] allowed_direct_url_schemes = [] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] api_rate_limit = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] auth_strategy = keystone {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_availability_zone = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_host = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_name = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_stats_polling_interval = 60 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backup_api_class = cinder.backup.api.API {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backup_name_template = backup-%s {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backup_use_same_host = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backup_use_temp_snapshot = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] chap_password = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] chap_username = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cinder_internal_tenant_project_id = 2dfbb205e32f4c538857fad0eadbb16e {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cinder_internal_tenant_user_id = 247e53871c484d5e8074e91b5c8b2029 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cluster = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] compression_format = gzip {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] compute_api_class = cinder.compute.nova.API {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] config_dir = [] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] config_source = [] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] control_exchange = openstack {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] debug = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] default_availability_zone = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] default_group_type = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] default_volume_type = QuobyteHD {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] disk_geometry = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] driver_client_cert = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] driver_client_cert_key = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] driver_data_namespace = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] driver_ssl_cert_path = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] driver_ssl_cert_verify = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] driver_use_ssl = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] enable_new_services = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] enable_unsupported_driver = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] enabled_backends = ['QuobyteHD'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] enforce_multipath_for_image_xfer = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] filter_function = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance_api_insecure = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance_api_servers = ['http://192.168.122.55/image'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance_api_ssl_compression = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance_ca_certificates_file = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance_catalog_info = image:glance:publicURL {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance_certfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance_keyfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance_num_retries = 3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance_request_timeout = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] goodness_function = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] graceful_shutdown_timeout = 5 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] group_api_class = cinder.group.api.API {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] host = devstack {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] image_compress_on_upload = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] image_conversion_address_space_limit = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] image_conversion_cpu_limit = 60 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] image_conversion_disable = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] image_upload_use_cinder_backend = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] image_upload_use_internal_tenant = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] image_volume_cache_enabled = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] image_volume_cache_max_count = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] image_volume_cache_max_size_gb = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] init_host_max_objects_retrieval = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] instance_format = [instance: %(uuid)s] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] iscsi_target_flags = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] iscsi_write_cache = on {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] iser_helper = tgtadm {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] iser_ip_address = 192.168.122.55 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] iser_port = 3260 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] log_color = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] log_config_append = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] log_dir = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] log_file = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] log_options = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] log_rotate_interval = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] log_rotate_interval_type = days {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] log_rotation_type = none {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] max_age = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] max_logfile_count = 30 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] max_logfile_size_mb = 200 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] max_over_subscription_ratio = 20.0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] message_reap_interval = 86400 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] message_ttl = 2592000 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] migration_create_volume_timeout_secs = 300 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] monkey_patch = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] monkey_patch_modules = [] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] my_ip = 192.168.122.55 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] no_snapshot_gb_quota = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] num_iser_scan_tries = 3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] num_shell_tries = 3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] num_volume_device_scan_tries = 3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] nvmeof_conn_info_version = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] nvmet_ns_id = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] nvmet_port_id = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] osapi_max_limit = 1000 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] osapi_volume_ext_list = [] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] osapi_volume_listen = 0.0.0.0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] osapi_volume_listen_port = 8776 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] osapi_volume_use_ssl = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82057) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] osapi_volume_workers = 2 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] per_volume_size_limit = -1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] periodic_fuzzy_delay = 60 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] periodic_interval = 60 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] project_id_regex = [0-9a-f\-]+ {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] public_endpoint = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] publish_errors = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] quota_backup_gigabytes = 1000 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] quota_backups = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] quota_gigabytes = 1000 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] quota_groups = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] quota_snapshots = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] quota_volumes = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] rate_limit_burst = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] rate_limit_except_level = CRITICAL {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] rate_limit_interval = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] reinit_driver_count = 3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] replication_device = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] report_discard_supported = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] report_interval = 120 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] reservation_clean_interval = 86400 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] reservation_expire = 86400 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] reserved_image_namespaces = [] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] reserved_percentage = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] rpc_response_timeout = 120 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] run_external_periodic_tasks = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] scst_target_driver = iscsi {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] scst_target_iqn_name = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] service_down_time = 720 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] shell_completion = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] snapshot_name_template = snapshot-%s {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] split_loggers = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] state_path = /opt/stack/data/cinder {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] storage_availability_zone = nova {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] storage_protocol = iSCSI {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] syslog_log_facility = LOG_USER {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] target_helper = lioadm {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] target_ip_address = 192.168.122.55 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] target_port = 3260 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] target_protocol = iscsi {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] target_secondary_ip_addresses = [] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] trace_flags = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] transfer_api_class = cinder.transfer.api.API {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] transport_url = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] until_refresh = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] use_chap_auth = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] use_default_quota_class = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] use_journal = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] use_json = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] use_multipath_for_image_xfer = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] use_stderr = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] use_syslog = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] verify_glance_signatures = enabled {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_api_class = cinder.volume.api.API {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_backend_name = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_clear = zero {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_clear_ionice = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_clear_size = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_copy_bps_limit = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_dd_blocksize = 1M {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_name_template = volume-%s {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_service_inithost_offload = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volume_usage_audit_period = month {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] zoning_mode = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_concurrency.disable_process_locking = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.admin_password = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.admin_token = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.admin_user = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.auth_admin_prefix = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.auth_port = 35357 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.auth_protocol = https {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.auth_section = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.auth_type = password {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.auth_uri = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.auth_version = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.cache = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.certfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.delay_auth_decision = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.http_connect_timeout = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.identity_uri = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.include_service_catalog = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.insecure = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.interface = public {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.keyfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_password = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcache_username = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.region_name = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.service_token_roles_required = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.service_type = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.token_cache_time = 300 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.55/identity {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.backend = dogpile.cache.null {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.backend_argument = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.backend_expiration_time = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.config_prefix = cache.oslo {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.debug_cache_backend = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.enable_retry_client = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.enable_socket_keepalive = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.enabled = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.enforce_fips_mode = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.expiration_time = 600 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.hashclient_retry_attempts = 2 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.memcache_dead_retry = 300 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.memcache_pool_maxsize = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.memcache_sasl_enabled = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.password = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.proxies = [] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.redis_db = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.redis_sentinel_service_name = mymaster {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.redis_server = localhost:6379 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.retry_attempts = 2 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.retry_delay = 0.0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.socket_keepalive_count = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.socket_keepalive_idle = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.socket_keepalive_interval = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.socket_timeout = 1.0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.tls_allowed_ciphers = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.tls_cafile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.tls_certfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.tls_enabled = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.tls_keyfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cache.username = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] coordination.backend_url = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.asyncio_connection = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.asyncio_slave_connection = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.backend = sqlalchemy {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.connection = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.connection_debug = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.connection_parameters = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.connection_recycle_time = 3600 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.connection_trace = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.db_inc_retry_interval = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.db_max_retries = 20 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.db_max_retry_interval = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.db_retry_interval = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.max_overflow = 50 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.max_pool_size = 5 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.max_retries = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.mysql_wsrep_sync_wait = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.pool_timeout = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.retry_interval = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.slave_connection = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.sqlite_synchronous = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.synchronous_reader = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] database.use_db_reconnect = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler.connection_string = messaging:// {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler.enabled = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler.es_doc_type = notification {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler.es_scroll_size = 10000 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler.es_scroll_time = 2m {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler.filter_error_trace = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler.hmac_keys = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler.sentinel_service_name = mymaster {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler.socket_timeout = 0.1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler.trace_requests = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler.trace_sqlalchemy = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler_jaeger.process_tags = {} {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler_jaeger.service_name_prefix = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] profiler_otlp.service_name_prefix = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_policy.enforce_new_defaults = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: WARNING oslo_config.cfg [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 19:10:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82057) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_policy.enforce_scope = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.quobyte [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 19:10:58 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.quobyte [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_policy.policy_default_rule = default {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_policy.policy_file = policy.yaml {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Running cmd (subprocess): mount.quobyte {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_policy.remote_timeout = 60.0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] privsep_osbrick.group = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] privsep_osbrick.helper_command = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] privsep_osbrick.user = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cinder_sys_admin.group = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cinder_sys_admin.helper_command = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] cinder_sys_admin.user = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] service_user.auth_section = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] service_user.auth_type = password {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] service_user.cafile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] service_user.certfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] service_user.collect_timing = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] service_user.insecure = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] service_user.keyfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] service_user.send_service_user_token = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] service_user.split_loggers = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] service_user.timeout = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance.auth_section = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance.auth_type = password {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance.certfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance.collect_timing = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance.insecure = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance.keyfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance.region_name = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance.split_loggers = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] glance.timeout = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.backend_availability_zone = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.chap_password = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.chap_username = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.disk_geometry = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.driver_client_cert = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.driver_client_cert_key = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.driver_data_namespace = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.driver_use_ssl = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.enable_unsupported_driver = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.extra_capabilities = {} {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.filter_function = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.goodness_function = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.iscsi_target_flags = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.iscsi_write_cache = on {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.iser_helper = tgtadm {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.iser_ip_address = 192.168.122.55 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.iser_port = 3260 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nas_host = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nas_login = admin {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nas_mount_options = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nas_password = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nas_private_key = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nas_share_path = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nas_ssh_port = 22 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.num_shell_tries = 3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.nvmet_port_id = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.quobyte_client_cfg = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.quobyte_volume_url = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.replication_device = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.report_discard_supported = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.reserved_percentage = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.scst_target_driver = iscsi {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.scst_target_iqn_name = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.storage_protocol = iSCSI {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.target_helper = tgtadm {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.target_ip_address = 192.168.122.55 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.target_port = 3260 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.target_protocol = iscsi {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.trace_flags = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.unique_fqdn_network = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.use_chap_auth = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.volume_backend_name = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.volume_clear = zero {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.volume_clear_ionice = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.volume_clear_size = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_reports.file_event_handler = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_reports.log_dir = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.backend_availability_zone = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.backend_host = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.chap_password = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.chap_username = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.chiscsi_conf = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.disk_geometry = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.driver_client_cert = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.driver_client_cert_key = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.driver_data_namespace = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.driver_use_ssl = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.extra_capabilities = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.filter_function = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.goodness_function = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.iscsi_target_flags = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.iscsi_write_cache = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.iser_helper = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.iser_ip_address = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.iser_port = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.iser_target_prefix = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nas_host = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nas_login = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nas_mount_options = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nas_password = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nas_private_key = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nas_share_path = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nas_ssh_port = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.num_shell_tries = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nvmet_ns_id = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.nvmet_port_id = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.replication_device = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.report_discard_supported = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.reserved_percentage = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.scst_target_driver = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.storage_protocol = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.target_helper = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.target_ip_address = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.target_port = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.target_prefix = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.target_protocol = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.trace_flags = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.unique_fqdn_network = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.use_chap_auth = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack quobyte-client[82062]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.volume_clear = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.volume_clear_ionice = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.volume_clear_size = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack quobyte-client[82062]: Invalid parameters found, error: missing mount point. Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack quobyte-client[82062]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 19:10:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:58 devstack quobyte-client[82062]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] QuobyteHD.volumes_dir = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.ssl = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.ssl_version = {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_notifications.driver = [] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_notifications.retry = -1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] oslo_messaging_notifications.transport_url = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] key_manager.fixed_key = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.barbican_api_version = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.barbican_endpoint = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.barbican_endpoint_type = public {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.barbican_region_name = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.cafile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.certfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.collect_timing = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.insecure = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.keyfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.number_of_retries = 60 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.retry_delay = 1 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.send_service_user_token = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.split_loggers = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.timeout = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.verify_ssl = True {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican.verify_ssl_path = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican_service_user.auth_section = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican_service_user.auth_type = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican_service_user.cafile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican_service_user.certfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican_service_user.collect_timing = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican_service_user.insecure = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican_service_user.keyfile = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican_service_user.split_loggers = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] barbican_service_user.timeout = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vault.approle_role_id = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vault.approle_secret_id = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vault.kv_mountpoint = secret {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vault.kv_path = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vault.kv_version = 2 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vault.namespace = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vault.root_token_id = **** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vault.ssl_ca_crt_file = None {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vault.timeout = 60.0 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vault.use_ssl = False {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 19:10:58 devstack cinder-volume[81819]: DEBUG oslo_service.backend._eventlet.service [None req-8b0aa9ce-7c56-43c9-81a8-a3fb03a42d4e None None] ******************************************************************************** {{(pid=81819) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 19:10:58 devstack sudo[82071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:10:58 devstack sudo[82071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:10:59 devstack sudo[82071]: pam_unix(sudo:session): session closed for user root Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.429s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:59 devstack cinder-volume[82057]: INFO cinder.volume.driver [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Driver hasn't implemented _init_vendor_properties() Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG cinder.volume.driver [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7242012023926, 'free_capacity_gb': 1775.7242012023926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82057) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG oslo_db.sqlalchemy.engines [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82057) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writer thread running {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG cinder.db.sqlalchemy.api [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Building query based on filter {{(pid=82057) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82057) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:59 devstack cinder-volume[82057]: INFO cinder.keymgr.migration [None req-2db784b6-d266-48ef-bdf3-42a89e503400 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 19:10:59 devstack sudo[82087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:10:59 devstack sudo[82087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:10:59 devstack sudo[82087]: pam_unix(sudo:session): session closed for user root Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.514s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:10:59 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Driver initialization completed successfully. Apr 24 19:10:59 devstack cinder-volume[82057]: INFO cinder.manager [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Initiating service 3 cleanup Apr 24 19:10:59 devstack cinder-volume[82057]: INFO cinder.manager [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Service 3 cleanup completed. Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG cinder.service [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Creating RPC server for service cinder-volume {{(pid=82057) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG cinder.service [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82057) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 19:10:59 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:10:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:10:59 devstack sudo[82091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:10:59 devstack sudo[82091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:00 devstack sudo[82091]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.503s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:00 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-83e64be5-30da-4e30-9ebd-99644894ca4c None None] Driver post RPC initialization completed successfully. Apr 24 19:11:08 devstack cinder-volume[81819]: DEBUG dbcounter [-] [81819] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81819) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:11:09 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=2 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:11:10 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Flow 'volume_create_manager' (f820ea4c-5a06-40d3-8bc4-8618f1aca212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b20d56-667f-42ef-9a0d-6181cb59c833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b20d56-667f-42ef-9a0d-6181cb59c833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1642126331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5d2a72-07ec-4011-9b69-5a5657c88fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea30e787a714f92ad9a08d8d9cef89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:11:57Z,use_quota=True,user_id='ccca1c5616d54644aded5c699eaaacc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9cfe1a-5941-4b33-af9f-772905c696f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9cfe1a-5941-4b33-af9f-772905c696f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6e3769-02e6-404f-b3b8-4cc443eb4337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6e3769-02e6-404f-b3b8-4cc443eb4337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5d2a72-07ec-4011-9b69-5a5657c88fcd', 'volume_name': 'volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effdad59-ff85-40b3-a13c-2ceac5f82233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effdad59-ff85-40b3-a13c-2ceac5f82233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4bea74-68bd-4846-9d17-846ba27e25e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:11:57 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd', 'volume_size': 1} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1642126331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5d2a72-07ec-4011-9b69-5a5657c88fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea30e787a714f92ad9a08d8d9cef89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:11:57Z,use_quota=True,user_id='ccca1c5616d54644aded5c699eaaacc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Creating volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:11:57 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:11:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:57 devstack sudo[82290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd 1073741824 Apr 24 19:11:57 devstack sudo[82290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:11:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:11:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:11:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:11:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:11:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:11:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:58 devstack sudo[82609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:11:58 devstack sudo[82609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:58 devstack sudo[82290]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd 1073741824" returned: 0 in 0.989s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:11:58 devstack sudo[82611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd Apr 24 19:11:58 devstack sudo[82611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:11:59 devstack sudo[82609]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.729s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:59 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:11:59 devstack sudo[82611]: pam_unix(sudo:session): session closed for user root Apr 24 19:11:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" returned: 0 in 0.942s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:11:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:11:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:11:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a4bea74-68bd-4846-9d17-846ba27e25e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:11:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dac075b-33ea-48e7-93c0-cb2838c9fff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:11:59 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Volume volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd (dd5d2a72-07ec-4011-9b69-5a5657c88fcd): created successfully Apr 24 19:11:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dac075b-33ea-48e7-93c0-cb2838c9fff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:11:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Flow 'volume_create_manager' (f820ea4c-5a06-40d3-8bc4-8618f1aca212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:11:59 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-91e94ba6-2c67-470d-9583-d7a246d5b6cb tempest-SnapshotsActionsTest-857957906 None] Created volume successfully. Apr 24 19:12:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:12:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:12:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Creating offline snapshot 40c97867-6269-4743-bee1-cb47e3bc3c0c of volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:12:00 devstack cinder-volume[82057]: INFO oslo.privsep.daemon [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu6uza7lw/privsep.sock'] Apr 24 19:12:00 devstack sudo[82616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu6uza7lw/privsep.sock Apr 24 19:12:00 devstack sudo[82616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:00 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 24 19:12:00 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:12:00 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 19:12:00 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:12:00 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:12:00 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 19:12:00 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:12:00 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:12:00 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 24 19:12:01 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 24 19:12:01 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 19:12:01 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 19:12:01 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:12:01 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 19:12:01 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 19:12:01 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 19:12:01 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 19:12:01 devstack cinder-volume[82057]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 24 19:12:01 devstack sudo[82616]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:01 devstack cinder-volume[82057]: INFO oslo.privsep.daemon [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Spawned new privsep daemon via rootwrap Apr 24 19:12:01 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Accepted privsep connection to /tmp/tmpu6uza7lw/privsep.sock {{(pid=82057) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 24 19:12:01 devstack cinder-volume[82057]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 24 19:12:01 devstack cinder-volume[82057]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 24 19:12:01 devstack cinder-volume[82057]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 24 19:12:01 devstack cinder-volume[82057]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82622 Apr 24 19:12:01 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90d6611-f478-4ece-8563-4d89453ab442]: (2,) {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:01 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f12a72-cd77-4864-bdbe-2816d0108978]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:02 devstack sudo[82626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd Apr 24 19:12:02 devstack sudo[82626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:02 devstack sudo[82626]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" returned: 0 in 0.709s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:02 devstack sudo[82639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c 1G Apr 24 19:12:02 devstack sudo[82639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:03 devstack sudo[82639]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c 1G" returned: 0 in 0.922s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:03 devstack sudo[82653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:03 devstack sudo[82653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:04 devstack sudo[82653]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 0.996s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:04 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c is being set with open permissions: ugo+rw Apr 24 19:12:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:04 devstack sudo[82676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:04 devstack sudo[82676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:05 devstack sudo[82676]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 0.641s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:05 devstack sudo[82681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.info Apr 24 19:12:05 devstack sudo[82681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:06 devstack sudo[82681]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.info" returned: 0 in 0.772s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:06 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.info is being set with open permissions: ugo+rw Apr 24 19:12:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:06 devstack sudo[82688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.info Apr 24 19:12:06 devstack sudo[82688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:06 devstack sudo[82688]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.info" returned: 0 in 0.746s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.506s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:12:06 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-45a1640e-48f0-463d-b672-a889ea8381de tempest-SnapshotsActionsTest-857957906 None] Create snapshot completed successfully Apr 24 19:12:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:12:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:12:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] Creating offline snapshot 21bbff58-db91-42b2-98c5-df33688459e2 of volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:12:08 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11e7a04-6b0f-4455-bd44-8174748cc543]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:08 devstack sudo[82717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:08 devstack sudo[82717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:09 devstack sudo[82717]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 0.727s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:09 devstack sudo[82731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 1G Apr 24 19:12:09 devstack sudo[82731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:10 devstack sudo[82731]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 1G" returned: 0 in 1.088s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:10 devstack sudo[82773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 Apr 24 19:12:10 devstack sudo[82773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:11 devstack sudo[82773]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2" returned: 0 in 0.720s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:11 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 is being set with open permissions: ugo+rw Apr 24 19:12:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:11 devstack sudo[82791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 Apr 24 19:12:11 devstack sudo[82791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:12 devstack sudo[82791]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2" returned: 0 in 0.727s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.425s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:12:12 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3e87802c-ae39-417c-aef6-edb2bd79fac3 tempest-SnapshotsActionsTest-857957906 None] Create snapshot completed successfully Apr 24 19:12:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-21bbff58-db91-42b2-98c5-df33688459e2-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-21bbff58-db91-42b2-98c5-df33688459e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-quobyte-21bbff58-db91-42b2-98c5-df33688459e2" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-21bbff58-db91-42b2-98c5-df33688459e2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Deleting offline snapshot 21bbff58-db91-42b2-98c5-df33688459e2 of volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:12:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] snapshot_file for this snap is: volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:12:13 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84424a8-da51-4889-9490-3ec5cabe21b5]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:13 devstack sudo[82802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 Apr 24 19:12:13 devstack sudo[82802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:14 devstack sudo[82802]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2" returned: 0 in 0.826s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:14 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8e1e11-74d4-4143-8a32-afde1dfaaccf]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:14 devstack sudo[82810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:14 devstack sudo[82810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:15 devstack sudo[82810]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 0.927s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:15 devstack sudo[82831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 Apr 24 19:12:15 devstack sudo[82831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:16 devstack sudo[82831]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2" returned: 0 in 1.095s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:16 devstack sudo[82874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2 Apr 24 19:12:16 devstack sudo[82874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:17 devstack sudo[82874]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.21bbff58-db91-42b2-98c5-df33688459e2" returned: 0 in 0.999s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-21bbff58-db91-42b2-98c5-df33688459e2" released by "_delete_snapshot" :: held 4.010s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" released by "delete_snapshot" :: held 4.055s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:17 devstack cinder-volume[82057]: WARNING cinder.quota [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:12:17 devstack cinder-volume[82057]: WARNING cinder.quota [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:12:17 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Created reservations ['1dabfad3-58fd-443a-bfa4-6bf77961e6ed', '93e0c5af-391b-4596-95fb-d7d87cd923a3', '31509ed5-7561-48b3-ae1b-c76d58254d06', 'fcecd25b-baab-482c-92cc-88a4b55871cc'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:12:17 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Delete snapshot completed successfully. Apr 24 19:12:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e226b4bf-dca2-4466-bf1d-517aceb361a3 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-21bbff58-db91-42b2-98c5-df33688459e2-delete_snapshot" released by "delete_snapshot" :: held 4.499s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:12:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:12:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] Creating offline snapshot 92507437-69cb-435e-afb0-54cfcff198fb of volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:12:19 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d77d4f-ac2e-40ab-b5e0-b3958ec23138]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:20 devstack sudo[82930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:20 devstack sudo[82930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:21 devstack sudo[82930]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 2.207s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:22 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:22 devstack sudo[82951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb 1G Apr 24 19:12:22 devstack sudo[82951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:23 devstack sudo[82951]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb 1G" returned: 0 in 1.699s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:23 devstack sudo[82962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb Apr 24 19:12:23 devstack sudo[82962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Flow 'volume_create_manager' (fdb49d03-eb32-4d86-bdec-a0f55a27098c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36cda4dd-7760-401e-95a4-c7b571100ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36cda4dd-7760-401e-95a4-c7b571100ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-230905179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cfed16-7b39-4de5-9d05-b086d5067712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4dab325a724b9eada547a4b4e92967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:12:24Z,use_quota=True,user_id='8c0cead18f2445c684eb4f32cc2929e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcb3897-4146-4780-ac18-ea97d1edf81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcb3897-4146-4780-ac18-ea97d1edf81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893f40f9-02f0-48a9-917e-3c9a38fbd8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893f40f9-02f0-48a9-917e-3c9a38fbd8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8cfed16-7b39-4de5-9d05-b086d5067712', 'volume_name': 'volume-e8cfed16-7b39-4de5-9d05-b086d5067712', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c539363b-a795-4e6c-a1f8-48a2e581e961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c539363b-a795-4e6c-a1f8-48a2e581e961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b14045-243b-4134-b544-704c7ae887f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:23 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Volume e8cfed16-7b39-4de5-9d05-b086d5067712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8cfed16-7b39-4de5-9d05-b086d5067712', 'volume_size': 1} Apr 24 19:12:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:12:24 devstack sudo[82962]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb" returned: 0 in 1.084s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:24 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb is being set with open permissions: ugo+rw Apr 24 19:12:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:24 devstack sudo[82968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb Apr 24 19:12:24 devstack sudo[82968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:25 devstack sudo[82968]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb" returned: 0 in 0.842s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.151s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.764s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-230905179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cfed16-7b39-4de5-9d05-b086d5067712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4dab325a724b9eada547a4b4e92967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:12:24Z,use_quota=True,user_id='8c0cead18f2445c684eb4f32cc2929e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Creating volume e8cfed16-7b39-4de5-9d05-b086d5067712 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:12:25 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:12:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:25 devstack sudo[82971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712 1073741824 Apr 24 19:12:25 devstack sudo[82971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:25 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3ec3b5f8-c3db-475c-8dbb-c6be0d0bf475 tempest-SnapshotsActionsTest-857957906 None] Create snapshot completed successfully Apr 24 19:12:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-92507437-69cb-435e-afb0-54cfcff198fb-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-92507437-69cb-435e-afb0-54cfcff198fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.137s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-quobyte-92507437-69cb-435e-afb0-54cfcff198fb" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-92507437-69cb-435e-afb0-54cfcff198fb" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Deleting offline snapshot 92507437-69cb-435e-afb0-54cfcff198fb of volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:12:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] snapshot_file for this snap is: volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:12:27 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2e1158-b632-459a-a5a6-10f0a643029d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:27 devstack sudo[82977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb Apr 24 19:12:27 devstack sudo[82977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:28 devstack sudo[82971]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712 1073741824" returned: 0 in 2.282s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:28 devstack sudo[82984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712 Apr 24 19:12:28 devstack sudo[82984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:28 devstack sudo[82977]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb" returned: 0 in 1.000s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:28 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[5239b2fd-5728-4c70-bb92-5e514ad09676]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:28 devstack sudo[82987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:28 devstack sudo[82987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:30 devstack sudo[82987]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 1.660s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:30 devstack sudo[82984]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712" returned: 0 in 1.969s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] <== create_volume: return (4359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:12:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.371s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:12:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b14045-243b-4134-b544-704c7ae887f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8cfed16-7b39-4de5-9d05-b086d5067712', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:30 devstack sudo[83058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb Apr 24 19:12:30 devstack sudo[83058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc08959-1360-405e-aff2-2a9d438a3c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:30 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Volume volume-e8cfed16-7b39-4de5-9d05-b086d5067712 (e8cfed16-7b39-4de5-9d05-b086d5067712): created successfully Apr 24 19:12:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc08959-1360-405e-aff2-2a9d438a3c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Flow 'volume_create_manager' (fdb49d03-eb32-4d86-bdec-a0f55a27098c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:12:30 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-2c8d3545-3756-4704-b7b0-1616a0e2535c tempest-VolumesAdminNegativeTest-1920413011 None] Created volume successfully. Apr 24 19:12:31 devstack sudo[83058]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb" returned: 0 in 1.527s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:31 devstack sudo[83078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb Apr 24 19:12:31 devstack sudo[83078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Acquiring lock "cinder-e8cfed16-7b39-4de5-9d05-b086d5067712-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Lock "cinder-e8cfed16-7b39-4de5-9d05-b086d5067712-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Acquiring lock "cinder-quobyte-e8cfed16-7b39-4de5-9d05-b086d5067712" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Lock "cinder-quobyte-e8cfed16-7b39-4de5-9d05-b086d5067712" acquired by "delete_volume" :: waited 0.040s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:32 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74fe9b2-de36-4d60-af8c-77ef4fc67224]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:32 devstack sudo[83080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712 Apr 24 19:12:32 devstack sudo[83080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:32 devstack sudo[83078]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.92507437-69cb-435e-afb0-54cfcff198fb" returned: 0 in 1.245s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-92507437-69cb-435e-afb0-54cfcff198fb" released by "_delete_snapshot" :: held 5.827s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" released by "delete_snapshot" :: held 5.883s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:32 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Created reservations ['bc108a74-b15a-44bd-be5a-fd90e36c8730', '52e2277d-2baf-4dbf-94eb-896debd91c6c', '9d6204e0-88c3-4825-ba68-434f563b8fb9', '4d226110-2c3f-4d14-80d9-eb3a9ba11052'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:12:33 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Delete snapshot completed successfully. Apr 24 19:12:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0eeea085-ecfd-4a64-a5e5-2bbf36353889 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-92507437-69cb-435e-afb0-54cfcff198fb-delete_snapshot" released by "delete_snapshot" :: held 6.155s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:33 devstack sudo[83080]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712" returned: 0 in 0.987s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:33 devstack sudo[83088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712 Apr 24 19:12:33 devstack sudo[83088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:34 devstack sudo[83088]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e8cfed16-7b39-4de5-9d05-b086d5067712" returned: 0 in 0.820s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Lock "cinder-quobyte-e8cfed16-7b39-4de5-9d05-b086d5067712" released by "delete_volume" :: held 1.857s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:34 devstack cinder-volume[82057]: WARNING cinder.quota [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Created reservations ['32154489-f19d-42d7-b4c3-2d54124d8fa8', 'b4942b7e-2b38-4d6f-aa0c-b1cf1aebf868', '4900dac1-82ec-4891-894c-d787be9ac186', 'c9732565-85f7-4b54-b2b4-538c02527b3f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:12:34 devstack sudo[83093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:12:34 devstack sudo[83093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] Creating offline snapshot eec337fc-3333-489a-93c6-48099b57a41a of volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b93f1ab-da1a-4036-9417-8e3e14154118]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:34 devstack sudo[83095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:34 devstack sudo[83095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:35 devstack sudo[83093]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.101s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:35 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:12:35 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Deleted volume successfully. Apr 24 19:12:35 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cb7f578d-e3ac-49bf-bcae-1dbcff05bb62 tempest-VolumesAdminNegativeTest-1920413011 None] Lock "cinder-e8cfed16-7b39-4de5-9d05-b086d5067712-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:35 devstack sudo[83095]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 1.284s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:35 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:35 devstack sudo[83135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a 1G Apr 24 19:12:35 devstack sudo[83135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:36 devstack sudo[83135]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a 1G" returned: 0 in 1.094s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:36 devstack sudo[83164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a Apr 24 19:12:36 devstack sudo[83164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:37 devstack sudo[83164]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a" returned: 0 in 0.750s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:37 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a is being set with open permissions: ugo+rw Apr 24 19:12:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:37 devstack sudo[83183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a Apr 24 19:12:37 devstack sudo[83183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:38 devstack sudo[83183]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a" returned: 0 in 0.572s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.888s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:12:38 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-85ffa4c0-9de3-4144-b266-c247eb54462e tempest-SnapshotsActionsTest-857957906 None] Create snapshot completed successfully Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-eec337fc-3333-489a-93c6-48099b57a41a-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-eec337fc-3333-489a-93c6-48099b57a41a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-quobyte-eec337fc-3333-489a-93c6-48099b57a41a" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-eec337fc-3333-489a-93c6-48099b57a41a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Deleting offline snapshot eec337fc-3333-489a-93c6-48099b57a41a of volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] snapshot_file for this snap is: volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21474ea-8c48-4e43-99f5-268ebc0cec02]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:38 devstack sudo[83190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a Apr 24 19:12:38 devstack sudo[83190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:39 devstack sudo[83190]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a" returned: 0 in 0.729s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:39 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[529b1033-bba1-49b8-be68-8f9cb3355660]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:39 devstack sudo[83205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:39 devstack sudo[83205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:40 devstack sudo[83205]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 0.794s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:40 devstack sudo[83227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a Apr 24 19:12:40 devstack sudo[83227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:41 devstack sudo[83227]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a" returned: 0 in 1.403s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:41 devstack sudo[83249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a Apr 24 19:12:41 devstack sudo[83249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:42 devstack sudo[83249]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.eec337fc-3333-489a-93c6-48099b57a41a" returned: 0 in 1.059s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:42 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-eec337fc-3333-489a-93c6-48099b57a41a" released by "_delete_snapshot" :: held 4.167s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:42 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" released by "delete_snapshot" :: held 4.203s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:42 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Created reservations ['0efa0518-0612-4478-84a6-b75f64a2e933', 'bf876e77-5bcd-47d1-84af-f7d07a046d2a', 'cd72c917-d4b9-4e54-aed5-eedb688b02ba', '876f6cb6-38a5-468d-9b82-327e0799ab58'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:12:43 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Delete snapshot completed successfully. Apr 24 19:12:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-602b35fa-a265-473c-8a9c-043afb53b46d tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-eec337fc-3333-489a-93c6-48099b57a41a-delete_snapshot" released by "delete_snapshot" :: held 4.511s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:12:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:12:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] Creating offline snapshot 9d0d853b-0f00-42b5-8014-557da4e58c62 of volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:12:44 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[981d7a6e-439b-47c1-affc-d2fe32126845]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:44 devstack sudo[83254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:44 devstack sudo[83254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:45 devstack sudo[83254]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 0.817s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:45 devstack sudo[83260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 1G Apr 24 19:12:45 devstack sudo[83260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:46 devstack sudo[83260]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 1G" returned: 0 in 1.413s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:46 devstack sudo[83265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 Apr 24 19:12:46 devstack sudo[83265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:48 devstack sudo[83265]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62" returned: 0 in 1.354s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:48 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 is being set with open permissions: ugo+rw Apr 24 19:12:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:48 devstack sudo[83271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 Apr 24 19:12:48 devstack sudo[83271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:49 devstack sudo[83271]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62" returned: 0 in 1.046s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.787s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:12:49 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-57295081-b946-4957-b601-4aca89807ba1 tempest-SnapshotsActionsTest-857957906 None] Create snapshot completed successfully Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-9d0d853b-0f00-42b5-8014-557da4e58c62-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-9d0d853b-0f00-42b5-8014-557da4e58c62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Acquiring lock "cinder-quobyte-9d0d853b-0f00-42b5-8014-557da4e58c62" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-9d0d853b-0f00-42b5-8014-557da4e58c62" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Deleting offline snapshot 9d0d853b-0f00-42b5-8014-557da4e58c62 of volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] snapshot_file for this snap is: volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec592d5-813c-4d55-89c7-1c45439a8843]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:50 devstack sudo[83303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 Apr 24 19:12:50 devstack sudo[83303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:50 devstack sudo[83303]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62" returned: 0 in 0.763s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[66140ac4-19c7-438e-b811-106d2073e66a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:51 devstack sudo[83309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:51 devstack sudo[83309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:51 devstack sudo[83309]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 0.775s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:51 devstack sudo[83314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 Apr 24 19:12:51 devstack sudo[83314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:52 devstack sudo[83314]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62" returned: 0 in 1.043s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:52 devstack sudo[83322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62 Apr 24 19:12:52 devstack sudo[83322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:53 devstack sudo[83322]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.9d0d853b-0f00-42b5-8014-557da4e58c62" returned: 0 in 0.578s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-9d0d853b-0f00-42b5-8014-557da4e58c62" released by "_delete_snapshot" :: held 3.290s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" released by "delete_snapshot" :: held 3.320s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:53 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=33,cinder:UPDATE=44,cinder:INSERT=8,cinder:DELETE=4 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:12:53 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:UPDATE=28,cinder:DELETE=4,cinder:SELECT=41,cinder:INSERT=11 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:12:53 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Created reservations ['83df7fa2-f2b4-43cf-b02c-e2b1722e37a9', 'faf891b5-7fdb-4f5b-a4f4-81614708b418', '64d6a6a6-6237-4ef6-b4bb-38d251b02d23', 'ef272489-76e1-4bde-afcd-e3dd3657267f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:12:53 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Delete snapshot completed successfully. Apr 24 19:12:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-030343bf-77eb-456b-99eb-156055abbec9 tempest-SnapshotsActionsTest-1722658751 None] Lock "cinder-9d0d853b-0f00-42b5-8014-557da4e58c62-delete_snapshot" released by "delete_snapshot" :: held 3.599s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "cinder-40c97867-6269-4743-bee1-cb47e3bc3c0c-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Lock "cinder-40c97867-6269-4743-bee1-cb47e3bc3c0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "cinder-quobyte-40c97867-6269-4743-bee1-cb47e3bc3c0c" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Lock "cinder-quobyte-40c97867-6269-4743-bee1-cb47e3bc3c0c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Deleting offline snapshot 40c97867-6269-4743-bee1-cb47e3bc3c0c of volume dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:12:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] snapshot_file for this snap is: volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:12:55 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b5e3f0-8ba2-49a6-95a0-45df9926021d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:55 devstack sudo[83342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:55 devstack sudo[83342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:55 devstack sudo[83342]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 0.727s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:12:55 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c0b615-7e34-45bd-ae8e-cf0beb2d326d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:55 devstack sudo[83348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd Apr 24 19:12:55 devstack sudo[83348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:56 devstack sudo[83348]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" returned: 0 in 0.713s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:56 devstack sudo[83353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:56 devstack sudo[83353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Flow 'volume_create_manager' (caeb6de8-9706-47e5-bec2-cdf1dbdc62fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70540fdc-ebdc-4a81-924b-19fca7d816f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70540fdc-ebdc-4a81-924b-19fca7d816f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-221621550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3ef17c-b4a2-4306-8afe-318350fe371e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d06d33f1c9a4ab7b3b233d4bd9130e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:12:57Z,use_quota=True,user_id='bc192dd4e94646ab8a196ef337bb9520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429abe9b-4566-48c2-8fe0-b542abb54a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429abe9b-4566-48c2-8fe0-b542abb54a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42918ab4-460a-494e-b9d8-7b82a25172e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42918ab4-460a-494e-b9d8-7b82a25172e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c3ef17c-b4a2-4306-8afe-318350fe371e', 'volume_name': 'volume-7c3ef17c-b4a2-4306-8afe-318350fe371e', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d283e702-7500-442c-88e8-db95f248c263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d283e702-7500-442c-88e8-db95f248c263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55139b88-b6e3-45ff-aa25-9c0809e4c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:57 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Volume 7c3ef17c-b4a2-4306-8afe-318350fe371e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c3ef17c-b4a2-4306-8afe-318350fe371e', 'volume_size': 1} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-221621550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3ef17c-b4a2-4306-8afe-318350fe371e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d06d33f1c9a4ab7b3b233d4bd9130e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:12:57Z,use_quota=True,user_id='bc192dd4e94646ab8a196ef337bb9520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Creating volume 7c3ef17c-b4a2-4306-8afe-318350fe371e {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:12:57 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:57 devstack sudo[83358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e 1073741824 Apr 24 19:12:57 devstack sudo[83358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:57 devstack sudo[83353]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 0.920s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:57 devstack sudo[83360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c Apr 24 19:12:57 devstack sudo[83360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:57 devstack sudo[83360]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd.40c97867-6269-4743-bee1-cb47e3bc3c0c" returned: 0 in 0.601s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Lock "cinder-quobyte-40c97867-6269-4743-bee1-cb47e3bc3c0c" released by "_delete_snapshot" :: held 3.092s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" released by "delete_snapshot" :: held 3.118s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Created reservations ['3f990d28-0d11-40f4-b750-6e4b28ef1d02', 'c9debc4b-4247-4fcc-8a7a-48424275dfc0', 'd98bbe9a-07cf-4b23-9f56-efd3be70020e', 'b4bd0c83-361c-48c2-9d7a-15ab1d83b308'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:12:58 devstack sudo[83358]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e 1073741824" returned: 0 in 0.923s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:58 devstack sudo[83368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e Apr 24 19:12:58 devstack sudo[83368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:12:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Delete snapshot completed successfully. Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d554c76c-28e5-41ef-981e-31c52961b24e tempest-SnapshotsActionsTest-857957906 None] Lock "cinder-40c97867-6269-4743-bee1-cb47e3bc3c0c-delete_snapshot" released by "delete_snapshot" :: held 3.364s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:12:58 devstack sudo[83368]: pam_unix(sudo:session): session closed for user root Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e" returned: 0 in 0.708s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55139b88-b6e3-45ff-aa25-9c0809e4c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c3ef17c-b4a2-4306-8afe-318350fe371e', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c0154f-4efb-4862-b5f9-e93fa2203e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:12:58 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Volume volume-7c3ef17c-b4a2-4306-8afe-318350fe371e (7c3ef17c-b4a2-4306-8afe-318350fe371e): created successfully Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c0154f-4efb-4862-b5f9-e93fa2203e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:12:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Flow 'volume_create_manager' (caeb6de8-9706-47e5-bec2-cdf1dbdc62fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:12:59 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-b628a0a5-41aa-41b9-a057-0d7d01e2618a tempest-ServersNegativeTestJSON-1736547467 None] Created volume successfully. Apr 24 19:12:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "cinder-dd5d2a72-07ec-4011-9b69-5a5657c88fcd-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Lock "cinder-dd5d2a72-07ec-4011-9b69-5a5657c88fcd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:12:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" acquired by "delete_volume" :: waited 0.042s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:12:59 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8b7682-9d14-4712-8161-9b60ece21c98]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:12:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:12:59 devstack sudo[83379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd Apr 24 19:12:59 devstack sudo[83379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:00 devstack sudo[83379]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" returned: 0 in 0.855s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:00 devstack sudo[83389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd Apr 24 19:13:00 devstack sudo[83389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:01 devstack sudo[83389]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" returned: 0 in 0.716s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Lock "cinder-quobyte-dd5d2a72-07ec-4011-9b69-5a5657c88fcd" released by "delete_volume" :: held 1.770s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:01 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Created reservations ['69ed83ed-174b-4377-9401-f9880403775a', '65ff7755-400c-40ac-9a93-20e068916af7', '0f990f72-f05c-499b-aa01-4c45ff3d7159', '9926942b-efc0-47fc-ad5b-98501c92ad24'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:01 devstack sudo[83406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:13:01 devstack sudo[83406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:02 devstack sudo[83406]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.035s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:02 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Deleted volume successfully. Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bdb05446-30e2-4e3f-a1b2-b72a2868dce0 tempest-SnapshotsActionsTest-857957906 None] Lock "cinder-dd5d2a72-07ec-4011-9b69-5a5657c88fcd-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Flow 'volume_create_manager' (82a27a70-a130-4847-8863-3cafa005e7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f73be8-0eef-48ab-a510-59363e80217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f73be8-0eef-48ab-a510-59363e80217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-726971495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b21b4fd-c209-46bb-9c03-f9061ce30529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d06d33f1c9a4ab7b3b233d4bd9130e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:02Z,use_quota=True,user_id='bc192dd4e94646ab8a196ef337bb9520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88688bf-419b-4692-8d3c-37541c414929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88688bf-419b-4692-8d3c-37541c414929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4ad08b-270b-46c6-b21a-dd3b914d72dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4ad08b-270b-46c6-b21a-dd3b914d72dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b21b4fd-c209-46bb-9c03-f9061ce30529', 'volume_name': 'volume-7b21b4fd-c209-46bb-9c03-f9061ce30529', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df3fb63-ea2c-48da-809f-1533a5d48113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df3fb63-ea2c-48da-809f-1533a5d48113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0b731e-fa7e-461b-a996-5e4253b9123a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:02 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Volume 7b21b4fd-c209-46bb-9c03-f9061ce30529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b21b4fd-c209-46bb-9c03-f9061ce30529', 'volume_size': 1} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-726971495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b21b4fd-c209-46bb-9c03-f9061ce30529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d06d33f1c9a4ab7b3b233d4bd9130e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:02Z,use_quota=True,user_id='bc192dd4e94646ab8a196ef337bb9520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Creating volume 7b21b4fd-c209-46bb-9c03-f9061ce30529 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:13:02 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:13:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:02 devstack sudo[83411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529 1073741824 Apr 24 19:13:02 devstack sudo[83411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:03 devstack sudo[83411]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529 1073741824" returned: 0 in 1.025s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:03 devstack sudo[83417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529 Apr 24 19:13:03 devstack sudo[83417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:04 devstack sudo[83417]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529" returned: 0 in 0.645s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:13:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0b731e-fa7e-461b-a996-5e4253b9123a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b21b4fd-c209-46bb-9c03-f9061ce30529', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a191cb68-b7f3-4d3a-baf7-65a45d66cc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:04 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Volume volume-7b21b4fd-c209-46bb-9c03-f9061ce30529 (7b21b4fd-c209-46bb-9c03-f9061ce30529): created successfully Apr 24 19:13:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a191cb68-b7f3-4d3a-baf7-65a45d66cc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Flow 'volume_create_manager' (82a27a70-a130-4847-8863-3cafa005e7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:04 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6576650e-5b8f-4b08-8f37-d026d6afa2d5 tempest-ServersNegativeTestJSON-1736547467 None] Created volume successfully. Apr 24 19:13:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Acquiring lock "cinder-7b21b4fd-c209-46bb-9c03-f9061ce30529-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Lock "cinder-7b21b4fd-c209-46bb-9c03-f9061ce30529-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Acquiring lock "cinder-quobyte-7b21b4fd-c209-46bb-9c03-f9061ce30529" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Lock "cinder-quobyte-7b21b4fd-c209-46bb-9c03-f9061ce30529" acquired by "delete_volume" :: waited 0.033s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:05 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad8501d-fe62-462f-8f9a-e988ceff4c35]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:05 devstack sudo[83421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529 Apr 24 19:13:05 devstack sudo[83421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:06 devstack sudo[83421]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529" returned: 0 in 0.682s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:06 devstack sudo[83426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529 Apr 24 19:13:06 devstack sudo[83426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:07 devstack sudo[83426]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7b21b4fd-c209-46bb-9c03-f9061ce30529" returned: 0 in 0.776s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Lock "cinder-quobyte-7b21b4fd-c209-46bb-9c03-f9061ce30529" released by "delete_volume" :: held 1.505s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Created reservations ['e5db3039-f5ed-43d2-943a-87d93bce7b5a', 'c0f291bc-8dd6-4232-a334-b4d3c8148e32', 'f8e33a96-0d31-47a7-943c-81d9f6184efc', '31fa817b-fe22-49fc-b67e-8bfd58f71bb1'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:07 devstack sudo[83432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:13:07 devstack sudo[83432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Acquiring lock "cinder-7c3ef17c-b4a2-4306-8afe-318350fe371e-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Lock "cinder-7c3ef17c-b4a2-4306-8afe-318350fe371e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Acquiring lock "cinder-quobyte-7c3ef17c-b4a2-4306-8afe-318350fe371e" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Lock "cinder-quobyte-7c3ef17c-b4a2-4306-8afe-318350fe371e" acquired by "delete_volume" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:08 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[074fd037-8a4e-4745-972c-f033a015dd4b]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:08 devstack sudo[83432]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.815s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:08 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:08 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Deleted volume successfully. Apr 24 19:13:08 devstack sudo[83436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e Apr 24 19:13:08 devstack sudo[83436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-11b02759-55ed-4386-9778-d752313cf200 tempest-ServersNegativeTestJSON-1736547467 None] Lock "cinder-7b21b4fd-c209-46bb-9c03-f9061ce30529-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:08 devstack sudo[83436]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e" returned: 0 in 0.897s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:08 devstack sudo[83448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e Apr 24 19:13:08 devstack sudo[83448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:09 devstack sudo[83448]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7c3ef17c-b4a2-4306-8afe-318350fe371e" returned: 0 in 0.756s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:09 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Lock "cinder-quobyte-7c3ef17c-b4a2-4306-8afe-318350fe371e" released by "delete_volume" :: held 1.726s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:09 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Created reservations ['cd6bb4d6-7bf3-4a82-a5aa-88892605811d', '734550c0-f871-4e24-983c-09471ac455c0', '23c1c94c-b881-470f-bd8f-14b80f93cce3', '0cadf83c-b3ac-450d-b3bd-1b31525fb680'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:09 devstack sudo[83474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:13:10 devstack sudo[83474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:11 devstack sudo[83474]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.229s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:11 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:11 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Deleted volume successfully. Apr 24 19:13:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0be03f0d-9438-4224-bfd9-8e67bc92e18f tempest-ServersNegativeTestJSON-1736547467 None] Lock "cinder-7c3ef17c-b4a2-4306-8afe-318350fe371e-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Flow 'volume_create_manager' (110dd614-a593-4eb2-b6de-a9bd0514d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11614897-23ff-4a20-993d-9b4e32391abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11614897-23ff-4a20-993d-9b4e32391abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1124880403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f229646-8213-4ccb-bacc-a95dcb44e6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9ba5b186574ba29e96aca590d0cd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:14Z,use_quota=True,user_id='872c46b01def4ca6a13a9ffaa41c53b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6266be8-0469-4bae-bfe2-9b78d93facb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6266be8-0469-4bae-bfe2-9b78d93facb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5529d3cb-5d11-46bd-aa53-a77eeaa4107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5529d3cb-5d11-46bd-aa53-a77eeaa4107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f229646-8213-4ccb-bacc-a95dcb44e6c4', 'volume_name': 'volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee75d79-bd07-47a8-955b-44616e863c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee75d79-bd07-47a8-955b-44616e863c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc441a7a-2cee-490d-b5fd-24eab5d5cd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:14 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Volume 1f229646-8213-4ccb-bacc-a95dcb44e6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4', 'volume_size': 1} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1124880403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f229646-8213-4ccb-bacc-a95dcb44e6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9ba5b186574ba29e96aca590d0cd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:14Z,use_quota=True,user_id='872c46b01def4ca6a13a9ffaa41c53b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Creating volume 1f229646-8213-4ccb-bacc-a95dcb44e6c4 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:13:14 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:13:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:14 devstack sudo[83524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 1073741824 Apr 24 19:13:14 devstack sudo[83524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:15 devstack sudo[83524]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 1073741824" returned: 0 in 1.137s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:15 devstack sudo[83530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 Apr 24 19:13:15 devstack sudo[83530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:17 devstack sudo[83530]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4" returned: 0 in 1.873s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] <== create_volume: return (3087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:13:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.097s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc441a7a-2cee-490d-b5fd-24eab5d5cd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e5ccfa-e58b-437f-80f7-d472aea79a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:17 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Volume volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 (1f229646-8213-4ccb-bacc-a95dcb44e6c4): created successfully Apr 24 19:13:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e5ccfa-e58b-437f-80f7-d472aea79a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Flow 'volume_create_manager' (110dd614-a593-4eb2-b6de-a9bd0514d19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:17 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3ce37d55-4d4d-4226-8780-6b041c4b0090 tempest-DeleteServersTestJSON-60368834 None] Created volume successfully. Apr 24 19:13:25 devstack cinder-volume[82057]: WARNING py.warnings [req-c4fac6eb-ce39-4fbf-a3bf-782065c58877 req-da8ef3c2-e525-4ca6-aae3-9631b1475d7f tempest-DeleteServersTestJSON-60368834 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 24 19:13:25 devstack cinder-volume[82057]: .first() Apr 24 19:13:25 devstack cinder-volume[82057]: Apr 24 19:13:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-c4fac6eb-ce39-4fbf-a3bf-782065c58877 req-da8ef3c2-e525-4ca6-aae3-9631b1475d7f tempest-DeleteServersTestJSON-60368834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-c4fac6eb-ce39-4fbf-a3bf-782065c58877 req-da8ef3c2-e525-4ca6-aae3-9631b1475d7f tempest-DeleteServersTestJSON-60368834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:25 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9feaf2-b2f5-40ad-aa76-c54ff58b061d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-c4fac6eb-ce39-4fbf-a3bf-782065c58877 req-da8ef3c2-e525-4ca6-aae3-9631b1475d7f tempest-DeleteServersTestJSON-60368834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:25 devstack sudo[83624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 Apr 24 19:13:25 devstack sudo[83624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:26 devstack sudo[83624]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-c4fac6eb-ce39-4fbf-a3bf-782065c58877 req-da8ef3c2-e525-4ca6-aae3-9631b1475d7f tempest-DeleteServersTestJSON-60368834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4" returned: 0 in 0.850s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-c4fac6eb-ce39-4fbf-a3bf-782065c58877 req-da8ef3c2-e525-4ca6-aae3-9631b1475d7f tempest-DeleteServersTestJSON-60368834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.909s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-c4fac6eb-ce39-4fbf-a3bf-782065c58877 req-da8ef3c2-e525-4ca6-aae3-9631b1475d7f tempest-DeleteServersTestJSON-60368834 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596', 'name': 'volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1192202b-2975-4b31-b394-1d9807c1256e', 'enforce_multipath': True} {{(pid=82057) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:13:26 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-c4fac6eb-ce39-4fbf-a3bf-782065c58877 req-da8ef3c2-e525-4ca6-aae3-9631b1475d7f tempest-DeleteServersTestJSON-60368834 None] attachment_update completed successfully. Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Flow 'volume_create_manager' (0e4ae48b-9f9a-4049-9f7d-ecc8089345f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b4f72e-4ae6-439c-a57c-11fbe18a480b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b4f72e-4ae6-439c-a57c-11fbe18a480b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-681746634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b161119a-2835-45bc-939b-e6936ff43ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25114fc787104098940782674dbd9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:28Z,use_quota=True,user_id='ab647e2e400b48d5afffd243a04eafaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a0d7dc-1209-4da7-b224-f63350f953f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a0d7dc-1209-4da7-b224-f63350f953f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6a4d5b-d525-46e1-962f-9ca36d6f87f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6a4d5b-d525-46e1-962f-9ca36d6f87f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b161119a-2835-45bc-939b-e6936ff43ff5', 'volume_name': 'volume-b161119a-2835-45bc-939b-e6936ff43ff5', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6b5565-977a-4f82-a920-a61443464af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6b5565-977a-4f82-a920-a61443464af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2e736c-7a0f-41d9-ab3b-7f1070af3f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:28 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Volume b161119a-2835-45bc-939b-e6936ff43ff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b161119a-2835-45bc-939b-e6936ff43ff5', 'volume_size': 1} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-681746634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b161119a-2835-45bc-939b-e6936ff43ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25114fc787104098940782674dbd9797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:28Z,use_quota=True,user_id='ab647e2e400b48d5afffd243a04eafaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Creating volume b161119a-2835-45bc-939b-e6936ff43ff5 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:13:28 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:13:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:28 devstack sudo[84023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5 1073741824 Apr 24 19:13:28 devstack sudo[84023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:29 devstack sudo[84023]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5 1073741824" returned: 0 in 0.871s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:29 devstack sudo[84030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5 Apr 24 19:13:29 devstack sudo[84030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:29 devstack sudo[84030]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5" returned: 0 in 0.637s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:13:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2e736c-7a0f-41d9-ab3b-7f1070af3f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b161119a-2835-45bc-939b-e6936ff43ff5', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b366726-ca32-4413-a4ce-09910028f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:30 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Volume volume-b161119a-2835-45bc-939b-e6936ff43ff5 (b161119a-2835-45bc-939b-e6936ff43ff5): created successfully Apr 24 19:13:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b366726-ca32-4413-a4ce-09910028f27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Flow 'volume_create_manager' (0e4ae48b-9f9a-4049-9f7d-ecc8089345f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:30 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1c08ddf7-7846-414a-a0cb-6b1b11e0cb11 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Created volume successfully. Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Acquiring lock "cinder-b161119a-2835-45bc-939b-e6936ff43ff5-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Lock "cinder-b161119a-2835-45bc-939b-e6936ff43ff5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Acquiring lock "cinder-quobyte-b161119a-2835-45bc-939b-e6936ff43ff5" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Flow 'volume_create_manager' (1677da56-8755-434b-9494-4fedea53854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a00c9e-65b8-4d5c-b050-b7e61f0aefe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Lock "cinder-quobyte-b161119a-2835-45bc-939b-e6936ff43ff5" acquired by "delete_volume" :: waited 0.117s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e53436-40a7-486c-a848-9a46d754e20b]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a00c9e-65b8-4d5c-b050-b7e61f0aefe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-869231080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9330cb36-8c3c-4265-ac35-2db1caae8895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9af54dedce24808916bc139b06b32f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:32Z,use_quota=True,user_id='f255a4c4b1a0470ea36372f8e620f9a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce6691c-c8f6-4a6c-8bd1-3bb5717c57c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce6691c-c8f6-4a6c-8bd1-3bb5717c57c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1180067-6e57-42b3-a010-269494d1cff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1180067-6e57-42b3-a010-269494d1cff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9330cb36-8c3c-4265-ac35-2db1caae8895', 'volume_name': 'volume-9330cb36-8c3c-4265-ac35-2db1caae8895', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949484f3-f0f1-4451-b4ec-61989eaf49d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949484f3-f0f1-4451-b4ec-61989eaf49d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:32 devstack sudo[84038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5 Apr 24 19:13:32 devstack sudo[84038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74d45b7-0e93-4323-bc19-69cc7857d3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:32 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Volume 9330cb36-8c3c-4265-ac35-2db1caae8895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9330cb36-8c3c-4265-ac35-2db1caae8895', 'volume_size': 1} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-869231080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9330cb36-8c3c-4265-ac35-2db1caae8895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9af54dedce24808916bc139b06b32f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:32Z,use_quota=True,user_id='f255a4c4b1a0470ea36372f8e620f9a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Creating volume 9330cb36-8c3c-4265-ac35-2db1caae8895 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:13:32 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:13:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:32 devstack sudo[84041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 1073741824 Apr 24 19:13:32 devstack sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:33 devstack sudo[84038]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5" returned: 0 in 0.922s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:33 devstack sudo[84072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5 Apr 24 19:13:33 devstack sudo[84072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:33 devstack sudo[84041]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 1073741824" returned: 0 in 1.204s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:33 devstack sudo[84092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 Apr 24 19:13:34 devstack sudo[84092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:34 devstack sudo[84072]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b161119a-2835-45bc-939b-e6936ff43ff5" returned: 0 in 0.882s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Lock "cinder-quobyte-b161119a-2835-45bc-939b-e6936ff43ff5" released by "delete_volume" :: held 1.905s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Created reservations ['790f20ba-ec41-46d9-8afe-c3ce37410571', 'fcf7dc87-3de3-48b0-aa17-d1dcc49474eb', '346b5fb1-879e-46c3-942f-fd5dfb618475', '19c4e78c-bfbb-453a-8aa5-129ae20c4ae9'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:34 devstack sudo[84122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:13:34 devstack sudo[84122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:34 devstack sudo[84092]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895" returned: 0 in 0.660s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c74d45b7-0e93-4323-bc19-69cc7857d3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9330cb36-8c3c-4265-ac35-2db1caae8895', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca293e79-369a-40cc-a5e5-f5dfc9d43dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:34 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Volume volume-9330cb36-8c3c-4265-ac35-2db1caae8895 (9330cb36-8c3c-4265-ac35-2db1caae8895): created successfully Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca293e79-369a-40cc-a5e5-f5dfc9d43dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Flow 'volume_create_manager' (1677da56-8755-434b-9494-4fedea53854d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:34 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-7e22cd2e-f797-40b7-be31-21f0fe7805eb req-8b6b57cb-92c0-4f5d-a078-8662fc9646e9 tempest-VolumesSnapshotsTestJSON-156473602 None] Created volume successfully. Apr 24 19:13:35 devstack sudo[84122]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.569s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:35 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:35 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Deleted volume successfully. Apr 24 19:13:35 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-038085a9-3356-431f-82d7-f2ff203bbdd8 tempest-VolumeQuotasNegativeTestJSON-1403833481 None] Lock "cinder-b161119a-2835-45bc-939b-e6936ff43ff5-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:35 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] Creating offline snapshot 1150586f-e16b-4ded-ab22-acbaaf00b5d0 of volume 9330cb36-8c3c-4265-ac35-2db1caae8895 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:13:35 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db7b410-eef0-455a-90ba-ebc0fc690e15]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:35 devstack sudo[84126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 Apr 24 19:13:35 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:36 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895" returned: 0 in 0.911s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:36 devstack sudo[84133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 1G Apr 24 19:13:36 devstack sudo[84133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:37 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-c0fb326e-392f-467a-bd13-0e963ec43619 req-e7f343f6-2ae0-4d8f-a361-7b641a855289 tempest-DeleteServersTestJSON-60368834 None] Terminate volume connection completed successfully. Apr 24 19:13:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-c0fb326e-392f-467a-bd13-0e963ec43619 req-e7f343f6-2ae0-4d8f-a361-7b641a855289 tempest-DeleteServersTestJSON-60368834 None] Deleting attachment 1192202b-2975-4b31-b394-1d9807c1256e. {{(pid=82057) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:13:37 devstack sudo[84133]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 1G" returned: 0 in 1.070s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9330cb36-8c3c-4265-ac35-2db1caae8895 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:37 devstack sudo[84142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9330cb36-8c3c-4265-ac35-2db1caae8895 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 Apr 24 19:13:37 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:38 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9330cb36-8c3c-4265-ac35-2db1caae8895 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0" returned: 0 in 0.807s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:38 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 is being set with open permissions: ugo+rw Apr 24 19:13:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:38 devstack sudo[84149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 Apr 24 19:13:38 devstack sudo[84149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:38 devstack sudo[84149]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0" returned: 0 in 0.562s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:38 devstack sudo[84152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.info Apr 24 19:13:38 devstack sudo[84152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:39 devstack sudo[84152]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.info" returned: 0 in 0.768s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:39 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.info is being set with open permissions: ugo+rw Apr 24 19:13:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:39 devstack sudo[84165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.info Apr 24 19:13:39 devstack sudo[84165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:40 devstack sudo[84165]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.info" returned: 0 in 0.686s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.991s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:40 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-962fb873-8a3c-4052-884d-bb62a0a92730 req-1c9b3c34-652d-4751-9147-dbdd0e8d45f6 tempest-VolumesSnapshotsTestJSON-156473602 None] Create snapshot completed successfully Apr 24 19:13:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Acquiring lock "cinder-1150586f-e16b-4ded-ab22-acbaaf00b5d0-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "cinder-1150586f-e16b-4ded-ab22-acbaaf00b5d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Acquiring lock "cinder-quobyte-9330cb36-8c3c-4265-ac35-2db1caae8895" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "cinder-quobyte-9330cb36-8c3c-4265-ac35-2db1caae8895" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Acquiring lock "cinder-quobyte-1150586f-e16b-4ded-ab22-acbaaf00b5d0" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "cinder-quobyte-1150586f-e16b-4ded-ab22-acbaaf00b5d0" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Deleting offline snapshot 1150586f-e16b-4ded-ab22-acbaaf00b5d0 of volume 9330cb36-8c3c-4265-ac35-2db1caae8895 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] snapshot_file for this snap is: volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b3870c-d5aa-4ecb-8e95-6fa7e6a4b309]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:41 devstack sudo[84202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 Apr 24 19:13:41 devstack sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Acquiring lock "cinder-1f229646-8213-4ccb-bacc-a95dcb44e6c4-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Lock "cinder-1f229646-8213-4ccb-bacc-a95dcb44e6c4-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Acquiring lock "cinder-quobyte-1f229646-8213-4ccb-bacc-a95dcb44e6c4" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Lock "cinder-quobyte-1f229646-8213-4ccb-bacc-a95dcb44e6c4" acquired by "delete_volume" :: waited 0.044s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea51eef-723c-4489-a369-89157dc2b13c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:41 devstack sudo[84206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 Apr 24 19:13:41 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:42 devstack sudo[84202]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0" returned: 0 in 0.973s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:42 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9330cb36-8c3c-4265-ac35-2db1caae8895(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:13:42 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[24842352-47b5-426f-a46a-5f069abb9dd0]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:42 devstack sudo[84212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 Apr 24 19:13:42 devstack sudo[84212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:42 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4" returned: 0 in 1.072s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:42 devstack sudo[84217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4 Apr 24 19:13:42 devstack sudo[84217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:43 devstack sudo[84212]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895" returned: 0 in 1.222s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:43 devstack sudo[84224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 Apr 24 19:13:43 devstack sudo[84224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:43 devstack sudo[84217]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1f229646-8213-4ccb-bacc-a95dcb44e6c4" returned: 0 in 0.733s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Lock "cinder-quobyte-1f229646-8213-4ccb-bacc-a95dcb44e6c4" released by "delete_volume" :: held 1.888s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:43 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Created reservations ['28a843b4-23e7-457c-b3d0-20d7d3033dd7', '0bbd64ca-c7da-4d80-aa97-ffa461386631', 'f3b8a082-5dac-4d14-92a5-7fa7d5e23967', 'feb7428b-d6ba-42dc-9a40-b85a23dc160e'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:44 devstack sudo[84226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:13:44 devstack sudo[84226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:44 devstack sudo[84224]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0" returned: 0 in 1.311s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:44 devstack sudo[84232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0 Apr 24 19:13:44 devstack sudo[84232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:45 devstack sudo[84226]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.112s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:45 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:45 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Deleted volume successfully. Apr 24 19:13:45 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d943316-8d9f-43f0-97ec-7e0a4e6a979a tempest-DeleteServersTestJSON-60368834 None] Lock "cinder-1f229646-8213-4ccb-bacc-a95dcb44e6c4-delete_volume" released by "delete_volume" :: held 3.586s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:45 devstack sudo[84232]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895.1150586f-e16b-4ded-ab22-acbaaf00b5d0" returned: 0 in 0.909s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:45 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "cinder-quobyte-1150586f-e16b-4ded-ab22-acbaaf00b5d0" released by "_delete_snapshot" :: held 4.690s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:45 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "cinder-quobyte-9330cb36-8c3c-4265-ac35-2db1caae8895" released by "delete_snapshot" :: held 4.773s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:45 devstack cinder-volume[82057]: DEBUG cinder.quota [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Created reservations ['edb8fe2e-98fe-4381-9e6c-f639ce4d1896', '4e996ae0-0006-4bf2-a887-3929e6b3eb40', '86ea244e-f45f-4777-ac29-f60c7bee18d5', '7f66ae66-6eff-48ef-a801-47255d9d870a'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:45 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Delete snapshot completed successfully. Apr 24 19:13:45 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e8855b6e-1c50-4e64-be9b-8385798b3596 req-aca56d01-6e22-4cb3-b457-ccdca4bc1e79 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "cinder-1150586f-e16b-4ded-ab22-acbaaf00b5d0-delete_snapshot" released by "delete_snapshot" :: held 4.986s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Acquiring lock "cinder-9330cb36-8c3c-4265-ac35-2db1caae8895-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "cinder-9330cb36-8c3c-4265-ac35-2db1caae8895-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Acquiring lock "cinder-quobyte-9330cb36-8c3c-4265-ac35-2db1caae8895" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:13:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "cinder-quobyte-9330cb36-8c3c-4265-ac35-2db1caae8895" acquired by "delete_volume" :: waited 0.051s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:13:47 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ec04d6-4a30-4dd7-bbad-68a14c1838e3]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:47 devstack sudo[84240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 Apr 24 19:13:47 devstack sudo[84240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:48 devstack sudo[84240]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895" returned: 0 in 1.033s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:48 devstack sudo[84247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895 Apr 24 19:13:48 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:49 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9330cb36-8c3c-4265-ac35-2db1caae8895" returned: 0 in 0.839s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "cinder-quobyte-9330cb36-8c3c-4265-ac35-2db1caae8895" released by "delete_volume" :: held 2.061s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:49 devstack cinder-volume[82057]: DEBUG cinder.quota [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Created reservations ['baa286d2-0e3c-49d6-a06b-ed04afb7224b', '411842f8-d83f-4528-9b0c-49cfc246c10c', 'f931934c-7c8a-4f47-937d-abd6832ca178', '9b71b6fc-4569-406d-a489-e133d63f7bfa'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:13:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:49 devstack sudo[84251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:13:49 devstack sudo[84251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:50 devstack sudo[84251]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.115s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:50 devstack cinder-volume[82057]: DEBUG cinder.manager [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:50 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Deleted volume successfully. Apr 24 19:13:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-235e7ebd-9f13-4ffe-b9c9-056de84b2e4c req-8bf8620c-642e-48b2-b53d-148ea397ef44 tempest-VolumesSnapshotsTestJSON-156473602 None] Lock "cinder-9330cb36-8c3c-4265-ac35-2db1caae8895-delete_volume" released by "delete_volume" :: held 3.662s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Flow 'volume_create_manager' (3250bfee-0598-48c0-a6bc-af330bf1a836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452fa294-9ddb-43c0-a0c6-9181ec7d1b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452fa294-9ddb-43c0-a0c6-9181ec7d1b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-123133543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16595fdf-0946-4475-b7cc-7a725e49257c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e935d648e5a346869a81f4175e5cc4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:51Z,use_quota=True,user_id='b63c6ccea7a84ef1b3ca07b48f656eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5de874-77a5-46a2-9120-8daac84c0a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5de874-77a5-46a2-9120-8daac84c0a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e52aab-5258-4c35-869c-8f6530a90f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e52aab-5258-4c35-869c-8f6530a90f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16595fdf-0946-4475-b7cc-7a725e49257c', 'volume_name': 'volume-16595fdf-0946-4475-b7cc-7a725e49257c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cd58be-3e0c-4bc4-99f2-e94ce8bf54c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cd58be-3e0c-4bc4-99f2-e94ce8bf54c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3e548e-f212-4e4c-98b8-9a0f107c8e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:51 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Volume 16595fdf-0946-4475-b7cc-7a725e49257c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16595fdf-0946-4475-b7cc-7a725e49257c', 'volume_size': 1} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-123133543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16595fdf-0946-4475-b7cc-7a725e49257c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e935d648e5a346869a81f4175e5cc4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:13:51Z,use_quota=True,user_id='b63c6ccea7a84ef1b3ca07b48f656eae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Creating volume 16595fdf-0946-4475-b7cc-7a725e49257c {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:13:51 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:13:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:51 devstack sudo[84276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c 1073741824 Apr 24 19:13:51 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:53 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c 1073741824" returned: 0 in 1.577s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:53 devstack sudo[84293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c Apr 24 19:13:53 devstack sudo[84293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:54 devstack sudo[84293]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c" returned: 0 in 0.859s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] <== create_volume: return (2524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.528s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:INSERT=24,cinder:UPDATE=95,cinder:SELECT=71,cinder:DELETE=5 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3e548e-f212-4e4c-98b8-9a0f107c8e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16595fdf-0946-4475-b7cc-7a725e49257c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd04a0b6-6ba8-4b34-b946-24500527c6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=63,cinder:INSERT=19,cinder:UPDATE=76,cinder:DELETE=7 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:13:54 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Volume volume-16595fdf-0946-4475-b7cc-7a725e49257c (16595fdf-0946-4475-b7cc-7a725e49257c): created successfully Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd04a0b6-6ba8-4b34-b946-24500527c6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Flow 'volume_create_manager' (3250bfee-0598-48c0-a6bc-af330bf1a836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:54 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-23ff1d18-690c-4051-a8d9-c601945a2cdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Created volume successfully. Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Creating offline snapshot c5ce8243-6676-4607-8b70-65557eb0783b of volume 16595fdf-0946-4475-b7cc-7a725e49257c {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[23799dde-dfb8-47e5-84f8-cf16ce917b6e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:13:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:55 devstack sudo[84322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c Apr 24 19:13:55 devstack sudo[84322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:55 devstack sudo[84322]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c" returned: 0 in 0.916s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:55 devstack sudo[84327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b 1G Apr 24 19:13:55 devstack sudo[84327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:56 devstack sudo[84327]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b 1G" returned: 0 in 1.060s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16595fdf-0946-4475-b7cc-7a725e49257c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:57 devstack sudo[84332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16595fdf-0946-4475-b7cc-7a725e49257c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b Apr 24 19:13:57 devstack sudo[84332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:57 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-62e638f8-5a8c-4a2d-b837-319ede8ada06 tempest-GroupSnapshotsTest-296629037 None] Group tempest-GroupSnapshotsTest-Group-1835748212: creating Apr 24 19:13:57 devstack sudo[84332]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16595fdf-0946-4475-b7cc-7a725e49257c -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b" returned: 0 in 1.016s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:57 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b is being set with open permissions: ugo+rw Apr 24 19:13:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-62e638f8-5a8c-4a2d-b837-319ede8ada06 tempest-GroupSnapshotsTest-296629037 None] Group tempest-GroupSnapshotsTest-Group-1835748212: created successfully Apr 24 19:13:58 devstack sudo[84337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b Apr 24 19:13:58 devstack sudo[84337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-62e638f8-5a8c-4a2d-b837-319ede8ada06 tempest-GroupSnapshotsTest-296629037 None] Create group completed successfully. Apr 24 19:13:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:13:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:13:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:13:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:13:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:13:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:13:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:58 devstack sudo[84339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:13:58 devstack sudo[84339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:58 devstack sudo[84337]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b" returned: 0 in 0.594s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:58 devstack sudo[84343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.info Apr 24 19:13:58 devstack sudo[84343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:59 devstack sudo[84339]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.816s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:13:59 devstack sudo[84343]: pam_unix(sudo:session): session closed for user root Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.info" returned: 0 in 0.883s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:13:59 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.info is being set with open permissions: ugo+rw Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:13:59 devstack sudo[84351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.info Apr 24 19:13:59 devstack sudo[84351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Flow 'volume_create_manager' (4b4df33e-c9a3-4b3f-b5df-b1c45d65aa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b608271-49c9-431a-b840-46c1cdd7904c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b608271-49c9-431a-b840-46c1cdd7904c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1480056885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7f926ae-54c7-4813-a4e6-165ae596ffca,host='devstack@QuobyteHD#QuobyteHD',id=3413d22a-844a-4124-bc84-50af5b6ef798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a9d77e3148a1920344ecd9789562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:00Z,use_quota=True,user_id='5fb72989263f449fa95da0e7387ebfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff16f01-704a-483b-b8fe-a03ad836828a),volume_type_id=aff16f01-704a-483b-b8fe-a03ad836828a)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d14b264-5215-4fff-b3b1-b6f29fc9349c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d14b264-5215-4fff-b3b1-b6f29fc9349c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5997972d-055d-4f8e-bf6a-1088adcde449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5997972d-055d-4f8e-bf6a-1088adcde449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3413d22a-844a-4124-bc84-50af5b6ef798', 'volume_name': 'volume-3413d22a-844a-4124-bc84-50af5b6ef798', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5773fef-c393-406d-a2ef-4f88bd4aa7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5773fef-c393-406d-a2ef-4f88bd4aa7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565fa67f-2235-4e37-b3b6-c165fd573dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:13:59 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Volume 3413d22a-844a-4124-bc84-50af5b6ef798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3413d22a-844a-4124-bc84-50af5b6ef798', 'volume_size': 1} Apr 24 19:13:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:00 devstack sudo[84351]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.info" returned: 0 in 0.713s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.329s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a7f926ae-54c7-4813-a4e6-165ae596ffca,created_at=2026-04-24T17:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1480056885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7f926ae-54c7-4813-a4e6-165ae596ffca,host='devstack@QuobyteHD#QuobyteHD',id=3413d22a-844a-4124-bc84-50af5b6ef798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a9d77e3148a1920344ecd9789562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:00Z,use_quota=True,user_id='5fb72989263f449fa95da0e7387ebfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff16f01-704a-483b-b8fe-a03ad836828a),volume_type_id=aff16f01-704a-483b-b8fe-a03ad836828a)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Creating volume 3413d22a-844a-4124-bc84-50af5b6ef798 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:00 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:14:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:00 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0bfde8ad-2eec-42b5-8d42-2730b00ed97a tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Create snapshot completed successfully Apr 24 19:14:00 devstack sudo[84356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 1073741824 Apr 24 19:14:00 devstack sudo[84356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:01 devstack sudo[84356]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 1073741824" returned: 0 in 0.826s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:01 devstack sudo[84361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 Apr 24 19:14:01 devstack sudo[84361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:01 devstack sudo[84361]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798" returned: 0 in 0.694s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565fa67f-2235-4e37-b3b6-c165fd573dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3413d22a-844a-4124-bc84-50af5b6ef798', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676c24df-6765-4d99-9c21-cba9d959a862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:01 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Volume volume-3413d22a-844a-4124-bc84-50af5b6ef798 (3413d22a-844a-4124-bc84-50af5b6ef798): created successfully Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676c24df-6765-4d99-9c21-cba9d959a862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Flow 'volume_create_manager' (4b4df33e-c9a3-4b3f-b5df-b1c45d65aa04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1cdebc79-d56c-44ca-a70b-3bad9f347fbd tempest-GroupSnapshotsTest-296629037 None] Created volume successfully. Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Acquiring lock "cinder-c5ce8243-6676-4607-8b70-65557eb0783b-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "cinder-c5ce8243-6676-4607-8b70-65557eb0783b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Acquiring lock "cinder-quobyte-16595fdf-0946-4475-b7cc-7a725e49257c" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "cinder-quobyte-16595fdf-0946-4475-b7cc-7a725e49257c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Acquiring lock "cinder-quobyte-c5ce8243-6676-4607-8b70-65557eb0783b" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "cinder-quobyte-c5ce8243-6676-4607-8b70-65557eb0783b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Deleting offline snapshot c5ce8243-6676-4607-8b70-65557eb0783b of volume 16595fdf-0946-4475-b7cc-7a725e49257c {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] snapshot_file for this snap is: volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b555eb9e-3de7-4584-a3a2-d1dd954a4a0d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:02 devstack sudo[84364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b Apr 24 19:14:02 devstack sudo[84364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:02 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] GroupSnapshot 2e69170a-211d-4347-b078-0d909c0de251: creating. Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] Group snapshot 2e69170a-211d-4347-b078-0d909c0de251: creating. {{(pid=82057) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] Creating offline snapshot d1856947-c904-4e68-89de-7b35fef92f9f of volume 3413d22a-844a-4124-bc84-50af5b6ef798 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cff152-6f03-481d-ab06-37b421c64229]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:03 devstack sudo[84369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 Apr 24 19:14:03 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:03 devstack sudo[84364]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b" returned: 0 in 1.015s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16595fdf-0946-4475-b7cc-7a725e49257c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:14:03 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f58a09-5e19-48fd-b610-c063b18319c8]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:03 devstack sudo[84371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c Apr 24 19:14:03 devstack sudo[84371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:03 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798" returned: 0 in 0.981s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:03 devstack sudo[84379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f 1G Apr 24 19:14:03 devstack sudo[84379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:03 devstack sudo[84371]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c" returned: 0 in 0.794s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:03 devstack sudo[84382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b Apr 24 19:14:03 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:04 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b" returned: 0 in 0.979s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:04 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b Apr 24 19:14:04 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:05 devstack sudo[84379]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f 1G" returned: 0 in 1.325s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3413d22a-844a-4124-bc84-50af5b6ef798 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:05 devstack sudo[84398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3413d22a-844a-4124-bc84-50af5b6ef798 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f Apr 24 19:14:05 devstack sudo[84398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:05 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c.c5ce8243-6676-4607-8b70-65557eb0783b" returned: 0 in 0.712s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "cinder-quobyte-c5ce8243-6676-4607-8b70-65557eb0783b" released by "_delete_snapshot" :: held 3.642s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "cinder-quobyte-16595fdf-0946-4475-b7cc-7a725e49257c" released by "delete_snapshot" :: held 3.679s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:05 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Created reservations ['3fc7b567-a77e-42d8-825e-0f0a71d45f00', '826aff4e-f501-4785-bfe9-117a4a542f79', '9c14e803-2893-4f9b-a051-461f74fe47ae', '967c0cc5-1513-44e6-8b8e-ed05883b5d4d'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:05 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Delete snapshot completed successfully. Apr 24 19:14:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-48c4a39c-4114-4b93-aeff-eaac2d0b2467 tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "cinder-c5ce8243-6676-4607-8b70-65557eb0783b-delete_snapshot" released by "delete_snapshot" :: held 3.991s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:06 devstack sudo[84398]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Flow 'volume_create_manager' (21f014ae-0d2d-45ab-bd11-cfcb42e1a34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06141d6-8d35-430b-9704-33c70543a1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3413d22a-844a-4124-bc84-50af5b6ef798 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f" returned: 0 in 1.154s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:06 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06141d6-8d35-430b-9704-33c70543a1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:06Z,deleted=False,deleted_at=None,display_description='',display_name='5dbdf13a-d254-41bc-af78-82da5ed26af8-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f5c5e7cad14572be369c74212e2f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:06Z,use_quota=True,user_id='8d18eac849d3456db9deb51f1ee5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9f8956-7609-45bb-a552-9ea05b2797f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:06 devstack sudo[84405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f Apr 24 19:14:06 devstack sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9f8956-7609-45bb-a552-9ea05b2797f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f40a553-ac31-4e74-85aa-4e798c149054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f40a553-ac31-4e74-85aa-4e798c149054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179', 'volume_name': 'volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46232ef2-ff5c-4802-910e-2f7e3c66191d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46232ef2-ff5c-4802-910e-2f7e3c66191d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0582e4db-e863-427f-aa55-2923421f7079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:06 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Volume 5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179', 'volume_size': 1} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Acquiring lock "cinder-16595fdf-0946-4475-b7cc-7a725e49257c-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "cinder-16595fdf-0946-4475-b7cc-7a725e49257c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Acquiring lock "cinder-quobyte-16595fdf-0946-4475-b7cc-7a725e49257c" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "cinder-quobyte-16595fdf-0946-4475-b7cc-7a725e49257c" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b3e997-16ea-4daa-9906-66e8e258a1cf]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:06 devstack sudo[84407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c Apr 24 19:14:06 devstack sudo[84407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:07 devstack sudo[84405]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f" returned: 0 in 0.959s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:07 devstack sudo[84410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.info Apr 24 19:14:07 devstack sudo[84410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:07 devstack sudo[84407]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c" returned: 0 in 1.159s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:07 devstack sudo[84417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c Apr 24 19:14:07 devstack sudo[84417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:08 devstack sudo[84410]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.info" returned: 0 in 0.744s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:08 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:08 devstack sudo[84420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.info Apr 24 19:14:08 devstack sudo[84420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:08 devstack sudo[84417]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16595fdf-0946-4475-b7cc-7a725e49257c" returned: 0 in 0.584s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "cinder-quobyte-16595fdf-0946-4475-b7cc-7a725e49257c" released by "delete_volume" :: held 1.842s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Created reservations ['17393b38-e0b2-4c6c-95c6-d038c22f5229', '11d10d98-73b9-4378-919a-2b29df1cb1e6', '66ae9f68-9a13-4161-8fb8-5a905b0089de', 'f1ef361d-ce02-4bbf-8a49-5cf32fd3f351'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:08 devstack sudo[84425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:14:08 devstack sudo[84425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:08 devstack sudo[84420]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.info" returned: 0 in 0.772s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.128s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.380s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:06Z,deleted=False,deleted_at=None,display_description='',display_name='5dbdf13a-d254-41bc-af78-82da5ed26af8-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f5c5e7cad14572be369c74212e2f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:06Z,use_quota=True,user_id='8d18eac849d3456db9deb51f1ee5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Creating volume 5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:08 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:14:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:09 devstack sudo[84427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 1073741824 Apr 24 19:14:09 devstack sudo[84427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:09 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-854a65b1-8870-4497-837d-8c77dc137374 tempest-GroupSnapshotsTest-296629037 None] group_snapshot 2e69170a-211d-4347-b078-0d909c0de251: created successfully Apr 24 19:14:09 devstack sudo[84425]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.044s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:09 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:09 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Deleted volume successfully. Apr 24 19:14:09 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a7bf332e-4a9e-45cd-a8c0-d546453f3f7f tempest-VolumeSnapshotQuotasNegativeTestJSON-1680127984 None] Lock "cinder-16595fdf-0946-4475-b7cc-7a725e49257c-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:10 devstack sudo[84427]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 1073741824" returned: 0 in 1.139s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:10 devstack sudo[84434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 Apr 24 19:14:10 devstack sudo[84434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:10 devstack sudo[84434]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179" returned: 0 in 0.675s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0582e4db-e863-427f-aa55-2923421f7079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b710117-de9a-4253-a93c-50f526b5f081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:10 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Volume volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 (5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179): created successfully Apr 24 19:14:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b710117-de9a-4253-a93c-50f526b5f081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Flow 'volume_create_manager' (21f014ae-0d2d-45ab-bd11-cfcb42e1a34f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:10 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-14487521-d7e5-4719-9c50-17a896479524 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Created volume successfully. Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-d1856947-c904-4e68-89de-7b35fef92f9f-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" by "_create_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-d1856947-c904-4e68-89de-7b35fef92f9f-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Creating volume 8f6b37f5-ed8d-48d8-867f-233dd03a6e67 from snapshot d1856947-c904-4e68-89de-7b35fef92f9f {{(pid=82057) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] snapshot: d1856947-c904-4e68-89de-7b35fef92f9f, volume: 8f6b37f5-ed8d-48d8-867f-233dd03a6e67, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ecb4a0-fa89-4f7f-8f88-faf7a2f97da3]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:11 devstack sudo[84438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f Apr 24 19:14:11 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:12 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f" returned: 0 in 1.054s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3413d22a-844a-4124-bc84-50af5b6ef798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:14:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:14:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:14:12 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2712ac31-2923-4ac8-9ce0-44f8e6f50c41]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:12 devstack sudo[84451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 Apr 24 19:14:12 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-05235576-f38b-4fae-be6b-d14cd7bb0777 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:13 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798" returned: 0 in 0.830s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:13 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67 not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:14:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:13 devstack sudo[84456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67 Apr 24 19:14:13 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:21 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=22,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Flow 'volume_create_manager' (a5a35516-b155-4181-be5c-135d06cf58bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f8f8b9-acaf-422d-8eff-1500995deb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f8f8b9-acaf-422d-8eff-1500995deb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-675816091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f7f34e-79c6-4485-8941-a9bac5d3b660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518a13f855f04adea6cb1f2c0b076d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:22Z,use_quota=True,user_id='bc333ceb156e4c9eac3c02cfb217678e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3caf1a02-0a2d-4de5-ad36-793ff9348c1f),volume_type_id=3caf1a02-0a2d-4de5-ad36-793ff9348c1f)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d102e3e-ad37-408e-abe7-f363a9c3b674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d102e3e-ad37-408e-abe7-f363a9c3b674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38968cc9-8c2f-47ce-95de-754de78677ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38968cc9-8c2f-47ce-95de-754de78677ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f7f34e-79c6-4485-8941-a9bac5d3b660', 'volume_name': 'volume-69f7f34e-79c6-4485-8941-a9bac5d3b660', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84678833-bc63-43a4-8e68-4dd5ab670be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84678833-bc63-43a4-8e68-4dd5ab670be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e32affe-0956-40c1-99f5-c11f0a362c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:22 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Volume 69f7f34e-79c6-4485-8941-a9bac5d3b660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f7f34e-79c6-4485-8941-a9bac5d3b660', 'volume_size': 1} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:22 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" returned: 0 in 8.630s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc081ce-c57e-4834-99ff-f137f9045ddd]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:22 devstack sudo[84529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 Apr 24 19:14:22 devstack sudo[84529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:23 devstack sudo[84529]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798" returned: 0 in 0.905s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:23 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67 {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:14:23 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Converted 1024.00 MB image at 118.64 MB/s Apr 24 19:14:23 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:14:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:23 devstack sudo[84534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67 Apr 24 19:14:23 devstack sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:23 devstack sudo[84534]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" returned: 0 in 0.627s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" released by "_copy_volume_from_snapshot" :: held 12.200s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-d1856947-c904-4e68-89de-7b35fef92f9f-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" released by "_create_volume_from_snapshot" :: held 12.293s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.333s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-05235576-f38b-4fae-be6b-d14cd7bb0777 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.948s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:23 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f6fe6c-d5ac-42df-9948-8f866c3b6d79]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-05235576-f38b-4fae-be6b-d14cd7bb0777 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:24 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-35259ddd-8aa6-4f74-8c9c-51e24992e0e0 tempest-GroupSnapshotsTest-296629037 None] Create group from source-snapshot-2e69170a-211d-4347-b078-0d909c0de251 completed successfully. Apr 24 19:14:24 devstack sudo[84541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 Apr 24 19:14:24 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:24 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" acquired by "delete_volume" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-05235576-f38b-4fae-be6b-d14cd7bb0777 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179" returned: 0 in 1.026s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-05235576-f38b-4fae-be6b-d14cd7bb0777 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.053s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.724s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-675816091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f7f34e-79c6-4485-8941-a9bac5d3b660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='518a13f855f04adea6cb1f2c0b076d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:22Z,use_quota=True,user_id='bc333ceb156e4c9eac3c02cfb217678e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3caf1a02-0a2d-4de5-ad36-793ff9348c1f),volume_type_id=3caf1a02-0a2d-4de5-ad36-793ff9348c1f)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Creating volume 69f7f34e-79c6-4485-8941-a9bac5d3b660 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:25 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:14:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:25 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2591b71a-84ea-4eaf-acde-a856ca245e3a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:25 devstack sudo[84559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660 1073741824 Apr 24 19:14:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:25 devstack sudo[84559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-05235576-f38b-4fae-be6b-d14cd7bb0777 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596', 'name': 'volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a49f298-971d-4ca0-b627-cd310fa937cd', 'enforce_multipath': True} {{(pid=82057) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:14:25 devstack sudo[84561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67 Apr 24 19:14:25 devstack sudo[84561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:25 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-df314ee9-320b-4fa3-bbe6-81d0497c3b25 req-05235576-f38b-4fae-be6b-d14cd7bb0777 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] attachment_update completed successfully. Apr 24 19:14:26 devstack sudo[84561]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" returned: 0 in 0.985s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:26 devstack sudo[84571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67 Apr 24 19:14:26 devstack sudo[84571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:26 devstack sudo[84559]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660 1073741824" returned: 0 in 1.315s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:26 devstack sudo[84574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660 Apr 24 19:14:26 devstack sudo[84574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:27 devstack sudo[84571]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" returned: 0 in 1.109s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:27 devstack sudo[84574]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-8f6b37f5-ed8d-48d8-867f-233dd03a6e67" released by "delete_volume" :: held 2.237s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660" returned: 0 in 0.820s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e32affe-0956-40c1-99f5-c11f0a362c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f7f34e-79c6-4485-8941-a9bac5d3b660', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0864233b-e334-498b-8708-37b9661e6479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:27 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Volume volume-69f7f34e-79c6-4485-8941-a9bac5d3b660 (69f7f34e-79c6-4485-8941-a9bac5d3b660): created successfully Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0864233b-e334-498b-8708-37b9661e6479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Flow 'volume_create_manager' (a5a35516-b155-4181-be5c-135d06cf58bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:27 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-579b5230-1e7e-49a6-a0ae-45d1240d6a20 tempest-VolumeTypesAccessTest-250718523 None] Created volume successfully. Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['56ca66f3-6665-4caa-935d-340a18cc4d60'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:27 devstack cinder-volume[82057]: WARNING cinder.quota [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-575170892 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-575170892, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:14:27 devstack cinder-volume[82057]: WARNING cinder.quota [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-575170892 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-575170892, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['67ce687a-e958-4ccd-907e-ad504b909db5', 'e9c9d0f5-b823-4692-96c6-4a0326fea318', '2003deaf-24a8-4ab7-b1f4-4190b8302519', '5da3b92c-5395-4204-b5a4-0fba5eec605d'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:27 devstack sudo[84661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:14:27 devstack sudo[84661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Acquiring lock "cinder-69f7f34e-79c6-4485-8941-a9bac5d3b660-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Lock "cinder-69f7f34e-79c6-4485-8941-a9bac5d3b660-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Acquiring lock "cinder-quobyte-69f7f34e-79c6-4485-8941-a9bac5d3b660" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Lock "cinder-quobyte-69f7f34e-79c6-4485-8941-a9bac5d3b660" acquired by "delete_volume" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6023904-e861-419a-865e-2850d16fc326]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:28 devstack sudo[84663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660 Apr 24 19:14:28 devstack sudo[84663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:28 devstack sudo[84661]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.673s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-bb034d9e-ec7a-4a1c-914a-eb08efa9a298 tempest-GroupSnapshotsTest-296629037 None] Delete group completed successfully. Apr 24 19:14:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] group_snapshot 2e69170a-211d-4347-b078-0d909c0de251: deleting Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] group_snapshot 2e69170a-211d-4347-b078-0d909c0de251: deleting {{(pid=82057) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-3413d22a-844a-4124-bc84-50af5b6ef798" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-3413d22a-844a-4124-bc84-50af5b6ef798" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-d1856947-c904-4e68-89de-7b35fef92f9f" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-d1856947-c904-4e68-89de-7b35fef92f9f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Deleting offline snapshot d1856947-c904-4e68-89de-7b35fef92f9f of volume 3413d22a-844a-4124-bc84-50af5b6ef798 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] snapshot_file for this snap is: volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c96369-cb7e-453f-9ce0-6485bddadc80]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:28 devstack sudo[84663]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660" returned: 0 in 0.707s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:28 devstack sudo[84674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660 Apr 24 19:14:28 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:28 devstack sudo[84673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f Apr 24 19:14:28 devstack sudo[84673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:29 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69f7f34e-79c6-4485-8941-a9bac5d3b660" returned: 0 in 0.615s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Lock "cinder-quobyte-69f7f34e-79c6-4485-8941-a9bac5d3b660" released by "delete_volume" :: held 1.365s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:29 devstack sudo[84673]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f" returned: 0 in 0.684s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3413d22a-844a-4124-bc84-50af5b6ef798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ca4997-7657-4583-b33d-70bebbdf6839]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:29 devstack cinder-volume[82057]: WARNING cinder.quota [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-166661410 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-166661410, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:14:29 devstack cinder-volume[82057]: WARNING cinder.quota [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-166661410 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-166661410, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Created reservations ['bc4d2008-b29e-438a-ad18-83365740df74', 'b2e549ff-f19e-4992-80ac-3e3fcb58c1ec', 'c8893e46-cb08-47ee-be23-dfaea6ad159f', '911437ff-df4d-49de-a55a-24fd081091a8'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:29 devstack sudo[84687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 Apr 24 19:14:29 devstack sudo[84687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:29 devstack sudo[84689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:14:29 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:30 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.648s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:30 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:30 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Deleted volume successfully. Apr 24 19:14:30 devstack sudo[84687]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798" returned: 0 in 0.892s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:30 devstack sudo[85012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f Apr 24 19:14:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a23b477-35d9-41b9-b988-3d57948e0e94 tempest-VolumeTypesAccessTest-250718523 None] Lock "cinder-69f7f34e-79c6-4485-8941-a9bac5d3b660-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:30 devstack sudo[85012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:31 devstack sudo[85012]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f" returned: 0 in 0.936s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:31 devstack sudo[85036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f Apr 24 19:14:31 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:32 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798.d1856947-c904-4e68-89de-7b35fef92f9f" returned: 0 in 0.737s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-d1856947-c904-4e68-89de-7b35fef92f9f" released by "_delete_snapshot" :: held 3.376s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-3413d22a-844a-4124-bc84-50af5b6ef798" released by "delete_snapshot" :: held 3.417s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:32 devstack cinder-volume[82057]: WARNING cinder.quota [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-575170892 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-575170892, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:14:32 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['1f830c69-96eb-4c9a-888a-c8f559abeaa5', 'b3b26f05-1b8d-44c3-aea6-0e0d846f0696', '4aa43a3a-b7ec-4d64-b763-c0235cf24d10', '6532804f-fcc9-4723-bef9-4b5b8a3d4007'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:32 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3695e080-8849-4f15-9894-8d3b95850e41 tempest-GroupSnapshotsTest-296629037 None] group_snapshot 2e69170a-211d-4347-b078-0d909c0de251: deleted successfully Apr 24 19:14:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-3413d22a-844a-4124-bc84-50af5b6ef798" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:14:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-3413d22a-844a-4124-bc84-50af5b6ef798" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:14:33 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[31194a91-9c4b-4495-9ad9-583509250fa4]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:33 devstack sudo[85080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 Apr 24 19:14:33 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:34 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798" returned: 0 in 1.086s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:34 devstack sudo[85113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798 Apr 24 19:14:34 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:35 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3413d22a-844a-4124-bc84-50af5b6ef798" returned: 0 in 0.667s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:35 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-3413d22a-844a-4124-bc84-50af5b6ef798" released by "delete_volume" :: held 1.836s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:14:35 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['034f11a5-a7bf-4c12-8179-c14e3723552a'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:35 devstack cinder-volume[82057]: WARNING cinder.db.sqlalchemy.api [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-575170892'] Apr 24 19:14:35 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['aa08013d-2495-4378-9d97-eea60689197e', '5615c0f4-446f-480c-a663-a25954fe48af', '93dc486d-2705-4bd7-bbc6-576da7a45668', '479a818a-522f-47a4-9052-8074833f3e70'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:14:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:35 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:35 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:35 devstack sudo[85129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:14:35 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:37 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.804s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:37 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:37 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3692f224-043c-46bb-9a72-e477211989f3 tempest-GroupSnapshotsTest-296629037 None] Delete group completed successfully. Apr 24 19:14:38 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d97ee994-bfcd-4a45-97a5-d40fa7bc7c72 tempest-GroupSnapshotsTest-296629037 None] Group tempest-GroupSnapshotsTest-Group-438673811: creating Apr 24 19:14:38 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d97ee994-bfcd-4a45-97a5-d40fa7bc7c72 tempest-GroupSnapshotsTest-296629037 None] Group tempest-GroupSnapshotsTest-Group-438673811: created successfully Apr 24 19:14:38 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d97ee994-bfcd-4a45-97a5-d40fa7bc7c72 tempest-GroupSnapshotsTest-296629037 None] Create group completed successfully. Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Flow 'volume_create_manager' (828a30e5-2ee8-42e5-8738-0c43a1899a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a56f3e-1891-4226-b96f-4625518afc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a56f3e-1891-4226-b96f-4625518afc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2066208784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9fe64aee-2d2c-4e3b-8812-572dafb01a54,host='devstack@QuobyteHD#QuobyteHD',id=f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a9d77e3148a1920344ecd9789562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:40Z,use_quota=True,user_id='5fb72989263f449fa95da0e7387ebfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15bdbff9-d29a-4904-8998-88f0ed8d34c1),volume_type_id=15bdbff9-d29a-4904-8998-88f0ed8d34c1)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe473eb2-1d42-4a54-bca3-802a1b788c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe473eb2-1d42-4a54-bca3-802a1b788c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e70b17b-7098-4cbf-b417-8df58826c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e70b17b-7098-4cbf-b417-8df58826c739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded', 'volume_name': 'volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096bc50b-0eb6-4cad-b36e-86fdfaf277d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096bc50b-0eb6-4cad-b36e-86fdfaf277d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddacc34-602c-4f64-8fa4-f67741f5c478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:40 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Volume f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded', 'volume_size': 1} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9fe64aee-2d2c-4e3b-8812-572dafb01a54,created_at=2026-04-24T17:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2066208784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9fe64aee-2d2c-4e3b-8812-572dafb01a54,host='devstack@QuobyteHD#QuobyteHD',id=f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a9d77e3148a1920344ecd9789562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:40Z,use_quota=True,user_id='5fb72989263f449fa95da0e7387ebfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15bdbff9-d29a-4904-8998-88f0ed8d34c1),volume_type_id=15bdbff9-d29a-4904-8998-88f0ed8d34c1)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Creating volume f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:40 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:14:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:40 devstack sudo[85192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded 1073741824 Apr 24 19:14:40 devstack sudo[85192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:42 devstack sudo[85192]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded 1073741824" returned: 0 in 1.831s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:42 devstack sudo[85198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded Apr 24 19:14:42 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:43 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded" returned: 0 in 0.880s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] <== create_volume: return (2805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.820s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddacc34-602c-4f64-8fa4-f67741f5c478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f099a2-bb37-4715-a81f-0db4fa3ea755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:43 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Volume volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded (f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded): created successfully Apr 24 19:14:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f099a2-bb37-4715-a81f-0db4fa3ea755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Flow 'volume_create_manager' (828a30e5-2ee8-42e5-8738-0c43a1899a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:43 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-cd1206ff-890b-40fe-92bf-fc2c463065c2 tempest-GroupSnapshotsTest-296629037 None] Created volume successfully. Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Flow 'volume_create_manager' (def510a0-4961-4e91-822b-ef67cc7144fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55f31c3-39ee-4c90-be25-c40b7ba87d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55f31c3-39ee-4c90-be25-c40b7ba87d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504580003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9fe64aee-2d2c-4e3b-8812-572dafb01a54,host='devstack@QuobyteHD#QuobyteHD',id=42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a9d77e3148a1920344ecd9789562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:45Z,use_quota=True,user_id='5fb72989263f449fa95da0e7387ebfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15bdbff9-d29a-4904-8998-88f0ed8d34c1),volume_type_id=15bdbff9-d29a-4904-8998-88f0ed8d34c1)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8511cfad-e86b-422d-b8db-df3bce7c1322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8511cfad-e86b-422d-b8db-df3bce7c1322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0f1712-bef8-4233-a2c8-cc351f4a574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0f1712-bef8-4233-a2c8-cc351f4a574e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1', 'volume_name': 'volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a6875a-ee19-470e-bbb2-a0ef40557f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a6875a-ee19-470e-bbb2-a0ef40557f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e68f39-a15f-4a0b-9b29-2146c5fe5a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:44 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Volume 42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1', 'volume_size': 1} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9fe64aee-2d2c-4e3b-8812-572dafb01a54,created_at=2026-04-24T17:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504580003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9fe64aee-2d2c-4e3b-8812-572dafb01a54,host='devstack@QuobyteHD#QuobyteHD',id=42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a9d77e3148a1920344ecd9789562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:45Z,use_quota=True,user_id='5fb72989263f449fa95da0e7387ebfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15bdbff9-d29a-4904-8998-88f0ed8d34c1),volume_type_id=15bdbff9-d29a-4904-8998-88f0ed8d34c1)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Creating volume 42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:14:45 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:14:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:45 devstack sudo[85202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 1073741824 Apr 24 19:14:45 devstack sudo[85202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:47 devstack sudo[85202]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 1073741824" returned: 0 in 2.010s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:47 devstack sudo[85237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 Apr 24 19:14:47 devstack sudo[85237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:48 devstack sudo[85237]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1" returned: 0 in 1.085s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] <== create_volume: return (3275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:14:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.280s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e68f39-a15f-4a0b-9b29-2146c5fe5a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8ccb51-59bc-4999-a420-3b66666ed01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:48 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Volume volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 (42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1): created successfully Apr 24 19:14:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8ccb51-59bc-4999-a420-3b66666ed01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Flow 'volume_create_manager' (def510a0-4961-4e91-822b-ef67cc7144fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:48 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-dbd9c431-7c04-4c7d-b134-5e5f4ee676ae tempest-GroupSnapshotsTest-296629037 None] Created volume successfully. Apr 24 19:14:49 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-52da5bd4-d2f7-4c43-9d05-58ab9cbf528b tempest-GroupSnapshotsTest-296629037 None] Update group completed successfully. Apr 24 19:14:50 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-da14ce8a-bfc5-46c7-9c2a-0fc623557b55 tempest-GroupSnapshotsTest-296629037 None] Update group completed successfully. Apr 24 19:14:51 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9e460e4e-13ca-4f16-984c-28dae1abc2de tempest-GroupSnapshotsTest-296629037 None] Update group completed successfully. Apr 24 19:14:53 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-ae098547-f2dc-490d-9ef7-c30fe69e7840 tempest-GroupSnapshotsTest-296629037 None] Update group completed successfully. Apr 24 19:14:55 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] GroupSnapshot db1d43e1-98c6-4c42-b979-6c861a370b6d: creating. Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Group snapshot db1d43e1-98c6-4c42-b979-6c861a370b6d: creating. {{(pid=82057) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:UPDATE=80,cinder:DELETE=6,cinder:SELECT=91,cinder:INSERT=17 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Creating offline snapshot 0009dfbf-2238-46f5-8614-b61fcfc29194 of volume 42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc64ec53-4cf3-4f95-8807-ddcb634d3aae]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Flow 'volume_create_manager' (312d2fb9-5cdf-4a4c-ae73-a7cd91247a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237bd654-6ec9-4b9c-971c-640ec080dbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237bd654-6ec9-4b9c-971c-640ec080dbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-458084416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8a3600-b504-4e82-8d26-fe1d15a82dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57783cb9e844395aa20df05ee8991dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:55Z,use_quota=True,user_id='633ad5f875d64064bde27a0aa1416736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456d90d5-ba0b-4672-99d7-449f69f09822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456d90d5-ba0b-4672-99d7-449f69f09822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:55 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 Apr 24 19:14:55 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684d56af-0eb5-499e-bcda-3dbde571e7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684d56af-0eb5-499e-bcda-3dbde571e7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8a3600-b504-4e82-8d26-fe1d15a82dca', 'volume_name': 'volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80e807d-be47-48bf-a009-b3e1fc29cdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80e807d-be47-48bf-a009-b3e1fc29cdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80288162-d5eb-4179-a16e-7299c356423a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:55 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Volume 3e8a3600-b504-4e82-8d26-fe1d15a82dca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca', 'volume_size': 1} Apr 24 19:14:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:56 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1" returned: 0 in 0.840s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:56 devstack sudo[85457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 1G Apr 24 19:14:56 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:57 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 1G" returned: 0 in 1.133s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:57 devstack sudo[85473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 Apr 24 19:14:57 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:14:58 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194" returned: 0 in 1.237s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:14:58 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:14:58 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Flow 'volume_create_manager' (e57d7b61-c0b8-4a7f-a400-41716f2d816a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099631b6-bb89-4037-87a5-f6ac1d873039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:58 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099631b6-bb89-4037-87a5-f6ac1d873039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1104954136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f5c1d3-b369-41ce-8662-19ff3ce062cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abb986491bc4284bc61b078c5477408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:58Z,use_quota=True,user_id='2fe8d0e051ed40a8b18ed755611b323a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebcb9fe-c470-4f50-af63-a26723c0ea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebcb9fe-c470-4f50-af63-a26723c0ea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f1593a-11d8-422e-ad43-9f66e06b27dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f1593a-11d8-422e-ad43-9f66e06b27dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f5c1d3-b369-41ce-8662-19ff3ce062cb', 'volume_name': 'volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e38dacf-de86-4f85-b360-5c3310ee1fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e38dacf-de86-4f85-b360-5c3310ee1fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ea680a-c18e-4bea-a33d-9f95dc041aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:14:58 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Volume d5f5c1d3-b369-41ce-8662-19ff3ce062cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb', 'volume_size': 1} Apr 24 19:14:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:14:58 devstack sudo[85508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 Apr 24 19:14:58 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:14:59 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.045s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:59 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:14:59 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root Apr 24 19:14:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194" returned: 0 in 0.982s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:14:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:14:59 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.info Apr 24 19:14:59 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:00 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.info" returned: 0 in 0.638s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:00 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:15:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:00 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.info Apr 24 19:15:00 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:01 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.info" returned: 0 in 0.775s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.979s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Creating offline snapshot 3bd1eea5-432a-48dd-99d0-54972f38f20b of volume f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:15:01 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[1023912d-0bb4-42fa-b90b-d2e51f8d2a15]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:01 devstack sudo[85529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded Apr 24 19:15:01 devstack sudo[85529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:02 devstack sudo[85529]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded" returned: 0 in 1.054s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:02 devstack sudo[85535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b 1G Apr 24 19:15:02 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:03 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b 1G" returned: 0 in 0.908s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:03 devstack sudo[85541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b Apr 24 19:15:03 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:03 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b" returned: 0 in 0.885s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:03 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:15:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:04 devstack sudo[85547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b Apr 24 19:15:04 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:04 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b" returned: 0 in 0.623s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:04 devstack sudo[85567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.info Apr 24 19:15:04 devstack sudo[85567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:05 devstack sudo[85567]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.info" returned: 0 in 1.163s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:05 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:15:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:05 devstack sudo[85612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.info Apr 24 19:15:05 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:06 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.info" returned: 0 in 0.763s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.520s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.869s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1104954136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f5c1d3-b369-41ce-8662-19ff3ce062cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0abb986491bc4284bc61b078c5477408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:58Z,use_quota=True,user_id='2fe8d0e051ed40a8b18ed755611b323a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Creating volume d5f5c1d3-b369-41ce-8662-19ff3ce062cb {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:06 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:15:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:06 devstack sudo[85624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb 1073741824 Apr 24 19:15:06 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:06 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3d160c6d-02f9-4fa3-a7fe-1a3461a33e82 tempest-GroupSnapshotsTest-296629037 None] group_snapshot db1d43e1-98c6-4c42-b979-6c861a370b6d: created successfully Apr 24 19:15:07 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] group_snapshot db1d43e1-98c6-4c42-b979-6c861a370b6d: deleting Apr 24 19:15:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] group_snapshot db1d43e1-98c6-4c42-b979-6c861a370b6d: deleting {{(pid=82057) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:15:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-0009dfbf-2238-46f5-8614-b61fcfc29194" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-0009dfbf-2238-46f5-8614-b61fcfc29194" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Deleting offline snapshot 0009dfbf-2238-46f5-8614-b61fcfc29194 of volume 42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:15:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] snapshot_file for this snap is: volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:15:07 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[150370a9-06c7-4e41-baf8-abb7c4a99162]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:07 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 Apr 24 19:15:07 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:08 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb 1073741824" returned: 0 in 1.459s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:08 devstack sudo[85652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb Apr 24 19:15:08 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:09 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194" returned: 0 in 1.588s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:15:09 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb" returned: 0 in 1.028s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] <== create_volume: return (2608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.615s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.704s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-458084416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8a3600-b504-4e82-8d26-fe1d15a82dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57783cb9e844395aa20df05ee8991dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:14:55Z,use_quota=True,user_id='633ad5f875d64064bde27a0aa1416736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Creating volume 3e8a3600-b504-4e82-8d26-fe1d15a82dca {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:09 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2258ef47-3114-43bd-a278-c83214ea3159]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ea680a-c18e-4bea-a33d-9f95dc041aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a66c9dd-797b-4150-9577-a9a1bf2319fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:09 devstack sudo[85676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca 1073741824 Apr 24 19:15:09 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Volume volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb (d5f5c1d3-b369-41ce-8662-19ff3ce062cb): created successfully Apr 24 19:15:09 devstack sudo[85676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a66c9dd-797b-4150-9577-a9a1bf2319fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Flow 'volume_create_manager' (e57d7b61-c0b8-4a7f-a400-41716f2d816a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:09 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-246d2f56-4f80-4df3-8103-3ab08e89daed tempest-ServerRescueNegativeTestJSON-2020314029 None] Created volume successfully. Apr 24 19:15:09 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 Apr 24 19:15:09 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:10 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1" returned: 0 in 1.307s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:10 devstack sudo[85740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 Apr 24 19:15:10 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:10 devstack sudo[85676]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca 1073741824" returned: 0 in 1.590s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:10 devstack sudo[85742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca Apr 24 19:15:10 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:11 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194" returned: 0 in 0.679s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:11 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194 Apr 24 19:15:11 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:11 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca" returned: 0 in 0.642s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80288162-d5eb-4179-a16e-7299c356423a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95461f2f-01a1-4963-a25b-c5cc414a7bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:11 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Volume volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca (3e8a3600-b504-4e82-8d26-fe1d15a82dca): created successfully Apr 24 19:15:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95461f2f-01a1-4963-a25b-c5cc414a7bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Flow 'volume_create_manager' (312d2fb9-5cdf-4a4c-ae73-a7cd91247a20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:11 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c0109d3f-64d5-4d8b-93a2-1c2dac8ca0de tempest-SnapshotMetadataTestJSON-1442191892 None] Created volume successfully. Apr 24 19:15:12 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1.0009dfbf-2238-46f5-8614-b61fcfc29194" returned: 0 in 0.737s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-0009dfbf-2238-46f5-8614-b61fcfc29194" released by "_delete_snapshot" :: held 4.590s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1" released by "delete_snapshot" :: held 4.624s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded" acquired by "delete_snapshot" :: waited 0.040s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-3bd1eea5-432a-48dd-99d0-54972f38f20b" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-3bd1eea5-432a-48dd-99d0-54972f38f20b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Deleting offline snapshot 3bd1eea5-432a-48dd-99d0-54972f38f20b of volume f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] snapshot_file for this snap is: volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[77823236-bc4f-4f61-8232-97f3cc480609]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] Creating offline snapshot 2bc3c73e-0b33-4500-ada3-83ed2438ef31 of volume 3e8a3600-b504-4e82-8d26-fe1d15a82dca {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b229732-c4ba-4851-8b84-99b35e4cba66]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:12 devstack sudo[85751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b Apr 24 19:15:12 devstack sudo[85751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:12 devstack sudo[85752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca Apr 24 19:15:12 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:13 devstack sudo[85751]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b" returned: 0 in 0.742s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:15:13 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2622e85e-a937-4eae-840e-a38f5cc371aa]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:13 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca" returned: 0 in 0.772s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:13 devstack sudo[85765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded Apr 24 19:15:13 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:13 devstack sudo[85767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 1G Apr 24 19:15:13 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:13 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded" returned: 0 in 0.722s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:13 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b Apr 24 19:15:13 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:14 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 1G" returned: 0 in 0.930s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:14 devstack sudo[85785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 Apr 24 19:15:14 devstack sudo[85785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:14 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b" returned: 0 in 1.001s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:14 devstack sudo[85813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b Apr 24 19:15:14 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:14 devstack sudo[85785]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31" returned: 0 in 0.874s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:14 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 is being set with open permissions: ugo+rw Apr 24 19:15:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:14 devstack sudo[85817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 Apr 24 19:15:14 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:15 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded.3bd1eea5-432a-48dd-99d0-54972f38f20b" returned: 0 in 0.580s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:15 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-3bd1eea5-432a-48dd-99d0-54972f38f20b" released by "_delete_snapshot" :: held 3.213s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:15 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded" released by "delete_snapshot" :: held 3.242s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:15 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31" returned: 0 in 0.559s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:15 devstack cinder-volume[82057]: WARNING cinder.quota [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1043835188 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1043835188, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:15 devstack cinder-volume[82057]: WARNING cinder.quota [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1043835188 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1043835188, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:15 devstack sudo[85821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.info Apr 24 19:15:15 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:15 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['a1b98cb7-b38e-482a-ac08-24226fbd3527', '29f3250e-5858-487f-8f1b-d529bd787146', 'a96426f2-571d-4550-9c99-0db609a5a7f1', '40e12f91-9b85-4186-bf83-cb02e4b6be66'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:15 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['b58f04aa-443c-4177-86fc-950baf96317a', '5108a3d2-abe9-47da-bffc-0b8a6f0ef1b9', '84831a41-7c86-4eb8-872d-8ca0b7defadd', '64eec4d9-80ca-4bc9-a175-acd911234a69'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:15 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9581ef42-778f-464e-a9d2-f54a7f60a1f7 tempest-GroupSnapshotsTest-296629037 None] group_snapshot db1d43e1-98c6-4c42-b979-6c861a370b6d: deleted successfully Apr 24 19:15:16 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.info" returned: 0 in 0.640s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:16 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.info is being set with open permissions: ugo+rw Apr 24 19:15:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:16 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.info Apr 24 19:15:16 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:16 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.info" returned: 0 in 0.620s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.529s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:16 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-cc17008c-92a6-4a39-a59a-e1a72bf031a7 tempest-SnapshotMetadataTestJSON-1442191892 None] Create snapshot completed successfully Apr 24 19:15:16 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:16 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:17 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36f18f5-8d3a-4874-a3cb-30f8ec19ac7c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:17 devstack sudo[85834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 Apr 24 19:15:17 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:17 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1" returned: 0 in 0.854s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:17 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1 Apr 24 19:15:17 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:18 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1" returned: 0 in 0.683s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-42fe7d92-ea3c-4042-a1f7-9a6e32dca3c1" released by "delete_volume" :: held 1.645s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded" acquired by "delete_volume" :: waited 0.037s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec12b18c-ef34-481d-9895-4f260a44099c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Acquiring lock "cinder-2bc3c73e-0b33-4500-ada3-83ed2438ef31-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "cinder-2bc3c73e-0b33-4500-ada3-83ed2438ef31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Acquiring lock "cinder-quobyte-3e8a3600-b504-4e82-8d26-fe1d15a82dca" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "cinder-quobyte-3e8a3600-b504-4e82-8d26-fe1d15a82dca" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Acquiring lock "cinder-quobyte-2bc3c73e-0b33-4500-ada3-83ed2438ef31" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:18 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded Apr 24 19:15:18 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "cinder-quobyte-2bc3c73e-0b33-4500-ada3-83ed2438ef31" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Deleting offline snapshot 2bc3c73e-0b33-4500-ada3-83ed2438ef31 of volume 3e8a3600-b504-4e82-8d26-fe1d15a82dca {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] snapshot_file for this snap is: volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5ebe86-f190-4613-9948-5b2545eafd0c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:18 devstack sudo[85881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 Apr 24 19:15:18 devstack sudo[85881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:19 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded" returned: 0 in 0.811s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:19 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded Apr 24 19:15:19 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:19 devstack sudo[85881]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31" returned: 0 in 0.827s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:15:19 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96d3f4c-0dbb-48ad-b25e-f47741612ee3]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:19 devstack sudo[85904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca Apr 24 19:15:19 devstack sudo[85904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:20 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded" returned: 0 in 0.782s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-f5aeb388-4e12-4e38-ad8e-5bfbd1e41ded" released by "delete_volume" :: held 1.723s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['82b5ea0f-868b-4066-bf02-9eb03c5d379d'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:20 devstack cinder-volume[82057]: WARNING cinder.quota [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1043835188 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1043835188, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['5d3798a6-b917-4c81-9265-9062d44c521d', '84d8fd68-9d92-447c-ac25-61c362aff97b', 'ce4669d8-563a-4dcf-962c-38eae6d064a2', '951c816a-710a-422e-bca9-40a6288f8e48'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['0df3ad19-7e15-4262-a6f8-00e0586d186d', 'e1c0fca3-b111-4c32-be90-206f8b0f6b33', '984b2029-6e8c-4b06-baf2-ff0028b29a84', '7ef03b4f-f031-48a6-9620-66652e64e6a2'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:20 devstack sudo[85904]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca" returned: 0 in 0.969s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:20 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 Apr 24 19:15:20 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:20 devstack sudo[85931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:15:20 devstack sudo[85931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:21 devstack sudo[85931]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.727s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:21 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:21 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-97b03c95-a048-4bb5-a127-b8cb383bf5d4 tempest-GroupSnapshotsTest-296629037 None] Delete group completed successfully. Apr 24 19:15:21 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31" returned: 0 in 0.937s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:21 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31 Apr 24 19:15:21 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:22 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=96,cinder:UPDATE=97,cinder:INSERT=21,cinder:DELETE=1 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:15:22 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7ac74463-fdd1-469b-b938-f90497643be9 tempest-GroupSnapshotsTest-296629037 None] Group tempest-GroupSnapshotsTest-Group-544982755: creating Apr 24 19:15:22 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7ac74463-fdd1-469b-b938-f90497643be9 tempest-GroupSnapshotsTest-296629037 None] Group tempest-GroupSnapshotsTest-Group-544982755: created successfully Apr 24 19:15:22 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7ac74463-fdd1-469b-b938-f90497643be9 tempest-GroupSnapshotsTest-296629037 None] Create group completed successfully. Apr 24 19:15:22 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca.2bc3c73e-0b33-4500-ada3-83ed2438ef31" returned: 0 in 1.173s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "cinder-quobyte-2bc3c73e-0b33-4500-ada3-83ed2438ef31" released by "_delete_snapshot" :: held 4.171s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "cinder-quobyte-3e8a3600-b504-4e82-8d26-fe1d15a82dca" released by "delete_snapshot" :: held 4.201s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:23 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Created reservations ['cf6d510b-d5a7-4696-ba1b-2c51929cdf81', 'd1ece0fe-1eaa-4800-b62e-bb91bb889832', '87083218-ccd6-48df-8ab9-62d88f3bfc6e', '112752c5-5ba8-4bd2-a99f-b34a15a6b67b'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:23 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Delete snapshot completed successfully. Apr 24 19:15:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f22a0a13-0c09-4508-aa45-8ecf9104c13f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "cinder-2bc3c73e-0b33-4500-ada3-83ed2438ef31-delete_snapshot" released by "delete_snapshot" :: held 4.399s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Acquiring lock "cinder-3e8a3600-b504-4e82-8d26-fe1d15a82dca-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "cinder-3e8a3600-b504-4e82-8d26-fe1d15a82dca-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Acquiring lock "cinder-quobyte-3e8a3600-b504-4e82-8d26-fe1d15a82dca" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "cinder-quobyte-3e8a3600-b504-4e82-8d26-fe1d15a82dca" acquired by "delete_volume" :: waited 0.045s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:24 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa84f4ca-d77b-4beb-b4a8-8a2d034e8b83]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:24 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Flow 'volume_create_manager' (56fec2f0-824f-4830-848e-27015fe759a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:24 devstack sudo[85975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca Apr 24 19:15:24 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead41780-bd65-49bc-bc2f-f2cc2fa2b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead41780-bd65-49bc-bc2f-f2cc2fa2b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-619898440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89599ae6-9af8-40c0-9c75-4dac51c7490c,host='devstack@QuobyteHD#QuobyteHD',id=fae0d88c-4e43-4c3e-a11e-9adccec91460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a9d77e3148a1920344ecd9789562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:25Z,use_quota=True,user_id='5fb72989263f449fa95da0e7387ebfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a477882a-3ac0-4ff1-aa2b-d1b20a40fe52),volume_type_id=a477882a-3ac0-4ff1-aa2b-d1b20a40fe52)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a750f4a-4528-45e5-a91a-1c9aa47c297c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a750f4a-4528-45e5-a91a-1c9aa47c297c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e46c19-60d2-4d97-b1db-a22bbc7a6d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e46c19-60d2-4d97-b1db-a22bbc7a6d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae0d88c-4e43-4c3e-a11e-9adccec91460', 'volume_name': 'volume-fae0d88c-4e43-4c3e-a11e-9adccec91460', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493aaf3f-d91a-4226-860a-36bb105fb6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493aaf3f-d91a-4226-860a-36bb105fb6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d805de-1776-41ed-8876-c787113dd6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:25 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Volume fae0d88c-4e43-4c3e-a11e-9adccec91460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae0d88c-4e43-4c3e-a11e-9adccec91460', 'volume_size': 1} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=89599ae6-9af8-40c0-9c75-4dac51c7490c,created_at=2026-04-24T17:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-619898440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=89599ae6-9af8-40c0-9c75-4dac51c7490c,host='devstack@QuobyteHD#QuobyteHD',id=fae0d88c-4e43-4c3e-a11e-9adccec91460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9a9d77e3148a1920344ecd9789562',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:25Z,use_quota=True,user_id='5fb72989263f449fa95da0e7387ebfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a477882a-3ac0-4ff1-aa2b-d1b20a40fe52),volume_type_id=a477882a-3ac0-4ff1-aa2b-d1b20a40fe52)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Creating volume fae0d88c-4e43-4c3e-a11e-9adccec91460 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:25 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:25 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 1073741824 Apr 24 19:15:25 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:25 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca" returned: 0 in 1.087s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:25 devstack sudo[85990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca Apr 24 19:15:25 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:26 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 1073741824" returned: 0 in 0.896s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:26 devstack sudo[85992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 Apr 24 19:15:26 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:26 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e8a3600-b504-4e82-8d26-fe1d15a82dca" returned: 0 in 0.634s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "cinder-quobyte-3e8a3600-b504-4e82-8d26-fe1d15a82dca" released by "delete_volume" :: held 1.876s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:26 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Created reservations ['37747990-ac96-468e-b442-12e8215da0e1', '2c66384b-4c17-4862-bc4b-598c91a58c6a', 'ef71019a-43be-40d8-9201-48f56bfcc986', 'be8eb1a1-9923-419f-8583-c70027280090'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:26 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:15:26 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:27 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460" returned: 0 in 0.933s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d805de-1776-41ed-8876-c787113dd6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae0d88c-4e43-4c3e-a11e-9adccec91460', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cef4efd-b42c-42f2-bc7c-6e85e0153267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:27 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Volume volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 (fae0d88c-4e43-4c3e-a11e-9adccec91460): created successfully Apr 24 19:15:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cef4efd-b42c-42f2-bc7c-6e85e0153267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Flow 'volume_create_manager' (56fec2f0-824f-4830-848e-27015fe759a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:27 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4da69669-8133-4832-a80c-54de67e6dc77 tempest-GroupSnapshotsTest-296629037 None] Created volume successfully. Apr 24 19:15:27 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.962s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:27 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:27 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Deleted volume successfully. Apr 24 19:15:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-970e92d2-2584-477d-9afc-bd93dc33820f tempest-SnapshotMetadataTestJSON-1442191892 None] Lock "cinder-3e8a3600-b504-4e82-8d26-fe1d15a82dca-delete_volume" released by "delete_volume" :: held 3.381s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] GroupSnapshot 3370a679-0e1c-4cf9-b30c-ca04b88d7e4f: creating. Apr 24 19:15:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] Group snapshot 3370a679-0e1c-4cf9-b30c-ca04b88d7e4f: creating. {{(pid=82057) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:15:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] Creating offline snapshot ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 of volume fae0d88c-4e43-4c3e-a11e-9adccec91460 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:15:28 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b2bf3c-e2ad-43c3-afec-33a03f6c8cd9]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:28 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 Apr 24 19:15:28 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:30 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460" returned: 0 in 1.861s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:30 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 1G Apr 24 19:15:30 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:33 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 1G" returned: 0 in 2.647s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:33 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 Apr 24 19:15:33 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:34 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272" returned: 0 in 1.361s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:34 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:15:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:34 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 Apr 24 19:15:34 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:35 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Acquiring lock "cinder-d5f5c1d3-b369-41ce-8662-19ff3ce062cb-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:35 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Lock "cinder-d5f5c1d3-b369-41ce-8662-19ff3ce062cb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:35 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Acquiring lock "cinder-quobyte-d5f5c1d3-b369-41ce-8662-19ff3ce062cb" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:35 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Lock "cinder-quobyte-d5f5c1d3-b369-41ce-8662-19ff3ce062cb" acquired by "delete_volume" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:35 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a4f644-cf75-40d2-9d03-4d1486a01c17]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:35 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb Apr 24 19:15:35 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:35 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272" returned: 0 in 1.280s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:35 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.info Apr 24 19:15:35 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:37 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb" returned: 0 in 1.467s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:37 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb Apr 24 19:15:37 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:37 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.info" returned: 0 in 1.362s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:37 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:37 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.info Apr 24 19:15:37 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Flow 'volume_create_manager' (d909acd1-5484-496e-9128-362fa6d4e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4a27f1-cf8b-40f4-8802-37e623cf1e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4a27f1-cf8b-40f4-8802-37e623cf1e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1029642102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4860f6b3-abe6-4281-b11a-8f26df308e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a03110e81d845daaed8d99559e73a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:38Z,use_quota=True,user_id='c1d77b5c287444be9a6d8e615ffcd9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a89bb8-86c0-4e2e-830a-454c67179d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a89bb8-86c0-4e2e-830a-454c67179d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6529ff-326e-4a35-8ee4-32c17e1b51bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6529ff-326e-4a35-8ee4-32c17e1b51bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4860f6b3-abe6-4281-b11a-8f26df308e5a', 'volume_name': 'volume-4860f6b3-abe6-4281-b11a-8f26df308e5a', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d53065-0445-405e-ad74-f4575f3e247a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d53065-0445-405e-ad74-f4575f3e247a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a77d1c-16a2-4d1b-b466-9894efd2cde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:37 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Volume 4860f6b3-abe6-4281-b11a-8f26df308e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4860f6b3-abe6-4281-b11a-8f26df308e5a', 'volume_size': 1} Apr 24 19:15:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:38 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d5f5c1d3-b369-41ce-8662-19ff3ce062cb" returned: 0 in 1.213s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Lock "cinder-quobyte-d5f5c1d3-b369-41ce-8662-19ff3ce062cb" released by "delete_volume" :: held 2.824s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Created reservations ['ef62ff64-33d2-4b01-b10e-5fbaa02cdd18', 'ce8899e4-7cb0-42f2-b423-213cc4311c7f', 'b3c1994b-3876-4ab6-bd82-bc99b634094d', '7e9f1179-c57a-487f-ab77-e5ab9c043ab2'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:38 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.info" returned: 0 in 1.184s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.866s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1029642102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4860f6b3-abe6-4281-b11a-8f26df308e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a03110e81d845daaed8d99559e73a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:38Z,use_quota=True,user_id='c1d77b5c287444be9a6d8e615ffcd9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Creating volume 4860f6b3-abe6-4281-b11a-8f26df308e5a {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:38 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:38 devstack sudo[86172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a 1073741824 Apr 24 19:15:38 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:38 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-28a7d2d8-9de0-4238-a666-87ddfae3641f tempest-GroupSnapshotsTest-296629037 None] group_snapshot 3370a679-0e1c-4cf9-b30c-ca04b88d7e4f: created successfully Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:38 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:15:38 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:39 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] group_snapshot 3370a679-0e1c-4cf9-b30c-ca04b88d7e4f: deleting Apr 24 19:15:39 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a 1073741824" returned: 0 in 1.521s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:40 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.336s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] group_snapshot 3370a679-0e1c-4cf9-b30c-ca04b88d7e4f: deleting {{(pid=82057) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:15:40 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Deleted volume successfully. Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-fae0d88c-4e43-4c3e-a11e-9adccec91460" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92283857-b49e-440f-9a55-2fb3bbff644d tempest-ServerRescueNegativeTestJSON-2020314029 None] Lock "cinder-d5f5c1d3-b369-41ce-8662-19ff3ce062cb-delete_volume" released by "delete_volume" :: held 4.918s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-fae0d88c-4e43-4c3e-a11e-9adccec91460" acquired by "delete_snapshot" :: waited 0.138s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-ce4b3cd6-b8cc-4d8e-9d27-4c945022b272" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:40 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a Apr 24 19:15:40 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-ce4b3cd6-b8cc-4d8e-9d27-4c945022b272" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Deleting offline snapshot ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 of volume fae0d88c-4e43-4c3e-a11e-9adccec91460 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] snapshot_file for this snap is: volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c19c245-a477-40d3-8f64-3e402647a8b1]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:40 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 Apr 24 19:15:40 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:42 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a" returned: 0 in 2.370s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:42 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] <== create_volume: return (4092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.107s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a77d1c-16a2-4d1b-b466-9894efd2cde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4860f6b3-abe6-4281-b11a-8f26df308e5a', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fa0175-1767-4fcc-a000-f1d63102912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:42 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Volume volume-4860f6b3-abe6-4281-b11a-8f26df308e5a (4860f6b3-abe6-4281-b11a-8f26df308e5a): created successfully Apr 24 19:15:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fa0175-1767-4fcc-a000-f1d63102912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Flow 'volume_create_manager' (d909acd1-5484-496e-9128-362fa6d4e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:42 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-75af8bb5-4324-4282-b053-772434e7a2c9 tempest-VolumesTransfersV355Test-1935732214 None] Created volume successfully. Apr 24 19:15:43 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272" returned: 0 in 2.641s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fae0d88c-4e43-4c3e-a11e-9adccec91460(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:15:43 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[60260e25-f91d-4c63-a5b4-1e132c7b351d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:43 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 Apr 24 19:15:43 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:45 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-b102613b-4fa8-45f0-bea3-d02a348ef310 tempest-VolumesTransfersV355Test-1425576955 None] Transfer volume completed successfully. Apr 24 19:15:45 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460" returned: 0 in 2.165s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:45 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 Apr 24 19:15:45 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:46 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Acquiring lock "cinder-4860f6b3-abe6-4281-b11a-8f26df308e5a-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:46 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Lock "cinder-4860f6b3-abe6-4281-b11a-8f26df308e5a-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:46 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Acquiring lock "cinder-quobyte-4860f6b3-abe6-4281-b11a-8f26df308e5a" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:46 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Lock "cinder-quobyte-4860f6b3-abe6-4281-b11a-8f26df308e5a" acquired by "delete_volume" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:46 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272" returned: 0 in 1.420s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:46 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0fd25-6a85-46e8-8a56-6a58d2c2dce1]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:46 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272 Apr 24 19:15:46 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:47 devstack sudo[86311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a Apr 24 19:15:47 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:47 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460.ce4b3cd6-b8cc-4d8e-9d27-4c945022b272" returned: 0 in 0.819s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-ce4b3cd6-b8cc-4d8e-9d27-4c945022b272" released by "_delete_snapshot" :: held 7.369s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-fae0d88c-4e43-4c3e-a11e-9adccec91460" released by "delete_snapshot" :: held 7.427s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:47 devstack cinder-volume[82057]: WARNING cinder.quota [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-763812780 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-763812780, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:47 devstack cinder-volume[82057]: WARNING cinder.quota [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-763812780 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-763812780, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:47 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] Created reservations ['ee7af46d-fad5-40f6-9cb0-6839f3e335ae', '8bc9ddc2-eaa8-4e82-8bf7-8fea594ec118', '8f0f379c-44b3-46c3-a0d6-482815ec413b', 'f96249bf-dba0-42d0-8c04-b1e117e8b1dc'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:48 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a" returned: 0 in 1.135s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:48 devstack sudo[86318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a Apr 24 19:15:48 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:48 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-90313bc1-fb2c-4474-9ccd-b3b92336e61e tempest-GroupSnapshotsTest-296629037 None] group_snapshot 3370a679-0e1c-4cf9-b30c-ca04b88d7e4f: deleted successfully Apr 24 19:15:48 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4860f6b3-abe6-4281-b11a-8f26df308e5a" returned: 0 in 0.591s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Lock "cinder-quobyte-4860f6b3-abe6-4281-b11a-8f26df308e5a" released by "delete_volume" :: held 1.828s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:48 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Created reservations ['f1a32085-3f08-4eed-8f42-cd861d832a8b', '34f9e914-83e2-4dcd-8cec-901a63d02f85', '1e983900-e82a-41b6-ab00-ccc968cef5c3', 'fdae911a-ad3c-463b-9a32-9a9e4e97dcc3'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:48 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:15:48 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "cinder-quobyte-fae0d88c-4e43-4c3e-a11e-9adccec91460" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-fae0d88c-4e43-4c3e-a11e-9adccec91460" acquired by "delete_volume" :: waited 0.050s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:49 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ae3c5e-4ed8-440b-8ef7-8a1ea31fcf4b]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:50 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 Apr 24 19:15:50 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:50 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Flow 'volume_create_manager' (20f591c6-cbec-4f18-beb9-f530b7ef3d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d152c7e4-525c-4a94-83dd-abca3f646d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.431s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d152c7e4-525c-4a94-83dd-abca3f646d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1692057369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a03110e81d845daaed8d99559e73a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:50Z,use_quota=True,user_id='c1d77b5c287444be9a6d8e615ffcd9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaf5ef8-fa70-4901-9655-b21dfbcbe480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaaf5ef8-fa70-4901-9655-b21dfbcbe480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d51b17a-8579-4b7d-809d-86f00b863532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d51b17a-8579-4b7d-809d-86f00b863532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4', 'volume_name': 'volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbcb0de5-97df-462b-a3f8-ce372fd713b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbcb0de5-97df-462b-a3f8-ce372fd713b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6fd369-116c-4dce-8b41-2aa0df957de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:50 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Volume 4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4', 'volume_size': 1} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1692057369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a03110e81d845daaed8d99559e73a4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:50Z,use_quota=True,user_id='c1d77b5c287444be9a6d8e615ffcd9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Creating volume 4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:15:50 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:50 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Deleted volume successfully. Apr 24 19:15:50 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4 1073741824 Apr 24 19:15:50 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4f714d92-861a-4383-a367-1155b82f6d70 tempest-VolumesTransfersV355Test-772884140 None] Lock "cinder-4860f6b3-abe6-4281-b11a-8f26df308e5a-delete_volume" released by "delete_volume" :: held 3.610s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:51 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460" returned: 0 in 1.140s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:51 devstack sudo[86366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460 Apr 24 19:15:51 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:51 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4 1073741824" returned: 0 in 1.264s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:51 devstack sudo[86373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4 Apr 24 19:15:51 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:52 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fae0d88c-4e43-4c3e-a11e-9adccec91460" returned: 0 in 1.013s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Lock "cinder-quobyte-fae0d88c-4e43-4c3e-a11e-9adccec91460" released by "delete_volume" :: held 2.351s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['86bf879c-0350-4e40-9b31-a9fa18cf9dd5'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:52 devstack cinder-volume[82057]: WARNING cinder.quota [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-763812780 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-763812780, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Created reservations ['08caad6a-9901-4c5e-b91d-5e098d520a62', '218fe545-62c6-4df2-9d51-5e61f492fb35', '89688526-fb5c-4632-ba4a-786298d287ef', '65a1a1a6-fa48-48f2-8617-1b0db519e442'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:52 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4" returned: 0 in 0.702s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6fd369-116c-4dce-8b41-2aa0df957de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb47313-a8ae-4845-b2da-6d530bd79b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:52 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Volume volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4 (4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4): created successfully Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb47313-a8ae-4845-b2da-6d530bd79b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Flow 'volume_create_manager' (20f591c6-cbec-4f18-beb9-f530b7ef3d75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:52 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e0a68f58-0698-4ab5-827c-94209cca3941 tempest-VolumesTransfersV355Test-1935732214 None] Created volume successfully. Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:52 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:15:52 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:53 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.702s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:53 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:53 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c3920c54-b667-432c-8b89-00f8c19170b9 tempest-GroupSnapshotsTest-296629037 None] Delete group completed successfully. Apr 24 19:15:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Acquiring lock "cinder-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Lock "cinder-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Acquiring lock "cinder-quobyte-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:15:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Lock "cinder-quobyte-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4" acquired by "delete_volume" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:15:53 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff66296c-05b6-47f5-9469-cda1fdf37035]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:15:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:54 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4 Apr 24 19:15:54 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:54 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4" returned: 0 in 0.769s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:54 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4 Apr 24 19:15:54 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:55 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4" returned: 0 in 0.668s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Lock "cinder-quobyte-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4" released by "delete_volume" :: held 1.502s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:55 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:UPDATE=86,cinder:SELECT=90,cinder:INSERT=26,cinder:DELETE=7 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:15:55 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Created reservations ['ae960d97-8c20-41d3-b23b-3a0400875aab', 'b3ea0570-678f-4f3a-86ac-0cf006162552', 'dc74f5ca-ad41-4aab-82ab-e83c40ca61c3', '070bb5fd-bcf1-4694-8afd-bd6270e24efc'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:15:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:55 devstack sudo[86400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:15:55 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:56 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.902s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:56 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:15:56 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Deleted volume successfully. Apr 24 19:15:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-93ab4103-80b4-4ed1-a78c-e11a3fa1687c tempest-VolumesTransfersV355Test-772884140 None] Lock "cinder-4feaa4e1-9db7-4372-b9ca-a1e9b7a8e2b4-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:15:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:15:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:15:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:15:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:15:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:15:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:15:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:15:58 devstack sudo[86405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:15:58 devstack sudo[86405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:15:59 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:15:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Flow 'volume_create_manager' (ff45a5d6-4e7b-4e68-bb3d-20e2cb616080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:15:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664c0ad0-5ff2-4a77-9fa2-ee67045e21fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664c0ad0-5ff2-4a77-9fa2-ee67045e21fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:59Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93bf68f-d42b-4949-ac39-353b2470c6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f5c5e7cad14572be369c74212e2f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:59Z,use_quota=True,user_id='8d18eac849d3456db9deb51f1ee5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c5220e-6e5f-41e2-8e3c-d21361428df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c5220e-6e5f-41e2-8e3c-d21361428df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:15:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1342b53-23ea-4705-8d78-ab887e8c46b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:15:59 devstack cinder-volume[82057]: DEBUG cinder.image.glance [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Creating Keystone auth plugin from conf {{(pid=82057) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:15:59 devstack sudo[86405]: pam_unix(sudo:session): session closed for user root Apr 24 19:15:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.283s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:15:59 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1342b53-23ea-4705-8d78-ab887e8c46b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b93bf68f-d42b-4949-ac39-353b2470c6bc', 'volume_name': 'volume-b93bf68f-d42b-4949-ac39-353b2470c6bc', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6db0d3-93a4-4e8a-8853-96bafad69659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6db0d3-93a4-4e8a-8853-96bafad69659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be4e89b-b1c1-4de2-b8be-c6b37e8d278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:01 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Volume b93bf68f-d42b-4949-ac39-353b2470c6bc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b93bf68f-d42b-4949-ac39-353b2470c6bc', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:16:01 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Trying to clone b93bf68f-d42b-4949-ac39-353b2470c6bc from image 89fa23e1-262a-416b-b193-8f71185c7514 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]). {{(pid=82057) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:16:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-fcaa2f2e-1076-4fd4-9ca3-5adb48a81980 tempest-GroupSnapshotsV319Test-876835748 None] Group tempest-GroupSnapshotsV319Test-Group-1294570088: creating Apr 24 19:16:01 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:16:01 devstack cinder-volume[82057]: INFO cinder.image.image_utils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:16:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-fcaa2f2e-1076-4fd4-9ca3-5adb48a81980 tempest-GroupSnapshotsV319Test-876835748 None] Group tempest-GroupSnapshotsV319Test-Group-1294570088: created successfully Apr 24 19:16:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-fcaa2f2e-1076-4fd4-9ca3-5adb48a81980 tempest-GroupSnapshotsV319Test-876835748 None] Create group completed successfully. Apr 24 19:16:01 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[92471821-61f3-436b-a118-0c1db6a2fecf]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:02 devstack sudo[86445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD Apr 24 19:16:02 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:02 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD" returned: 0 in 0.869s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:02 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Temporary image 89fa23e1-262a-416b-b193-8f71185c7514 is fetched for user 8d18eac849d3456db9deb51f1ee5f8b7. {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:16:02 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c448c3d-2406-4901-9b7b-c361078c70af]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:03 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD Apr 24 19:16:03 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Flow 'volume_create_manager' (913bc643-bfdf-4211-a74f-f281fc8c443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416cc8e1-f3b2-4865-b223-a99b5238d379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416cc8e1-f3b2-4865-b223-a99b5238d379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-66066656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4793085-a8fe-4283-9a60-522e3e399361,host='devstack@QuobyteHD#QuobyteHD',id=ce637043-2e35-4fca-af34-1eda3fe85c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140959b0e8e04c248271631a16ca3cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:04Z,use_quota=True,user_id='1a1b5bb63e284a8bbb4d60bc5d253310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f49fe7b-ba6a-403e-9f24-878cab3cf14c),volume_type_id=9f49fe7b-ba6a-403e-9f24-878cab3cf14c)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26d2057-f9f7-4ef0-8765-115dc7388460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26d2057-f9f7-4ef0-8765-115dc7388460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e0b0e8-1088-4acc-8fd1-ca3b11875897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e0b0e8-1088-4acc-8fd1-ca3b11875897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce637043-2e35-4fca-af34-1eda3fe85c4b', 'volume_name': 'volume-ce637043-2e35-4fca-af34-1eda3fe85c4b', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993fee64-54e1-4f2e-8ca6-9e0b47cb9cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993fee64-54e1-4f2e-8ca6-9e0b47cb9cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133edb15-b260-4561-9871-b5cf3ef56bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:03 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Volume ce637043-2e35-4fca-af34-1eda3fe85c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce637043-2e35-4fca-af34-1eda3fe85c4b', 'volume_size': 1} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d4793085-a8fe-4283-9a60-522e3e399361,created_at=2026-04-24T17:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-66066656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4793085-a8fe-4283-9a60-522e3e399361,host='devstack@QuobyteHD#QuobyteHD',id=ce637043-2e35-4fca-af34-1eda3fe85c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140959b0e8e04c248271631a16ca3cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:04Z,use_quota=True,user_id='1a1b5bb63e284a8bbb4d60bc5d253310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f49fe7b-ba6a-403e-9f24-878cab3cf14c),volume_type_id=9f49fe7b-ba6a-403e-9f24-878cab3cf14c)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Creating volume ce637043-2e35-4fca-af34-1eda3fe85c4b {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:03 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:03 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b 1073741824 Apr 24 19:16:03 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:03 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD" returned: 0 in 1.016s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:04 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b 1073741824" returned: 0 in 1.016s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:04 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b Apr 24 19:16:04 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:05 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b" returned: 0 in 0.735s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.684s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:15:59Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93bf68f-d42b-4949-ac39-353b2470c6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f5c5e7cad14572be369c74212e2f2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:15:59Z,use_quota=True,user_id='8d18eac849d3456db9deb51f1ee5f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Creating volume b93bf68f-d42b-4949-ac39-353b2470c6bc {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:05 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:05 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc 1073741824 Apr 24 19:16:05 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133edb15-b260-4561-9871-b5cf3ef56bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce637043-2e35-4fca-af34-1eda3fe85c4b', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d0777c-b69c-4805-8ef1-ee579865a96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:05 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Volume volume-ce637043-2e35-4fca-af34-1eda3fe85c4b (ce637043-2e35-4fca-af34-1eda3fe85c4b): created successfully Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d0777c-b69c-4805-8ef1-ee579865a96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Flow 'volume_create_manager' (913bc643-bfdf-4211-a74f-f281fc8c443e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:05 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e3733925-3091-446d-844b-3ea4d646904a tempest-GroupSnapshotsV319Test-876835748 None] Created volume successfully. Apr 24 19:16:06 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] GroupSnapshot 9d88040b-815d-400d-8383-578ff63c4aaf: creating. Apr 24 19:16:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] Group snapshot 9d88040b-815d-400d-8383-578ff63c4aaf: creating. {{(pid=82057) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 19:16:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:06 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc 1073741824" returned: 0 in 1.130s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:06 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc Apr 24 19:16:06 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:07 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc" returned: 0 in 0.717s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.120s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] Creating offline snapshot 4f32a6ca-3be7-4be7-9355-7945521a9e40 of volume ce637043-2e35-4fca-af34-1eda3fe85c4b {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Attempting download of 89fa23e1-262a-416b-b193-8f71185c7514 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}])) to volume b93bf68f-d42b-4949-ac39-353b2470c6bc. {{(pid=82057) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae61c19-718d-44b4-88b5-88514e4b5cc1]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b9d549-badb-4b68-9348-3dd698a25742]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_4xw9lyi2 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:07 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b Apr 24 19:16:07 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Flow 'volume_create_manager' (5e1a24f1-a036-4d75-8ae1-636cb11c3179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1ba22e-f815-482d-a381-6182bc8b658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1ba22e-f815-482d-a381-6182bc8b658b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1092543595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70c80dd-bef1-47e7-be3b-0b3882744652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ed28d21ee5403caff36fb396756fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:08Z,use_quota=True,user_id='73456118e56745bf90bf34f3cd386ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7799d0b8-c813-4979-b113-b96d92a63cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7799d0b8-c813-4979-b113-b96d92a63cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7640894d-52d6-48d6-a860-e8c769e8a261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:07 devstack cinder-volume[82057]: DEBUG cinder.image.glance [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Creating Keystone auth plugin from conf {{(pid=82057) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:16:07 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_4xw9lyi2 Apr 24 19:16:07 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7640894d-52d6-48d6-a860-e8c769e8a261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b70c80dd-bef1-47e7-be3b-0b3882744652', 'volume_name': 'volume-b70c80dd-bef1-47e7-be3b-0b3882744652', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e5fc4f-e697-4cc5-a41f-26332f1d4ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e5fc4f-e697-4cc5-a41f-26332f1d4ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75eb3246-5966-4c31-8d53-4be1b5e240e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:08 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Volume b70c80dd-bef1-47e7-be3b-0b3882744652: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b70c80dd-bef1-47e7-be3b-0b3882744652', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Trying to clone b70c80dd-bef1-47e7-be3b-0b3882744652 from image 89fa23e1-262a-416b-b193-8f71185c7514 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]). {{(pid=82057) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:16:08 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b" returned: 0 in 0.946s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:08 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 1G Apr 24 19:16:08 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:08 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_4xw9lyi2" returned: 0 in 0.989s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_4xw9lyi2 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:16:08 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddd68ae-8c52-44b0-a97f-2482bb260bc1]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:08 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_4xw9lyi2 Apr 24 19:16:08 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:08 devstack sudo[86486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD Apr 24 19:16:08 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:09 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 1G" returned: 0 in 0.823s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce637043-2e35-4fca-af34-1eda3fe85c4b -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:09 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce637043-2e35-4fca-af34-1eda3fe85c4b -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 Apr 24 19:16:09 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:09 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_4xw9lyi2" returned: 1 in 0.817s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_4xw9lyi2' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:16:09 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2021fa03-bf6d-419c-8f8b-0c9529b8a188]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:09 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD" returned: 0 in 0.809s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:09 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Temporary image 89fa23e1-262a-416b-b193-8f71185c7514 is fetched for user 73456118e56745bf90bf34f3cd386ffb. {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:16:09 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD Apr 24 19:16:09 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:09 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46b23d4-c200-4721-9f1f-62e5326e66ea]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:09 devstack sudo[86501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD Apr 24 19:16:09 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:10 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce637043-2e35-4fca-af34-1eda3fe85c4b -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40" returned: 0 in 0.731s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:10 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:10 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 Apr 24 19:16:10 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Flow 'volume_create_manager' (d62bf3c8-2c54-4846-8ba7-fa47fe9d1591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d5a91a-c082-46a1-8f35-41187f0b1ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d5a91a-c082-46a1-8f35-41187f0b1ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1921513922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef381d2-d871-4979-83a7-5003ecb01813,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16c95a36a418496d82b72a24853ffad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:10Z,use_quota=True,user_id='eee5dc05b74a4ab7bf8abd6eaa2bbe24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3fad7b-9e15-4034-98ed-ae7df9af1d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3fad7b-9e15-4034-98ed-ae7df9af1d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2168a01-ba78-4720-99e3-31feec7b0d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2168a01-ba78-4720-99e3-31feec7b0d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef381d2-d871-4979-83a7-5003ecb01813', 'volume_name': 'volume-fef381d2-d871-4979-83a7-5003ecb01813', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047fdcc0-c74e-4d3e-8821-46990cb4ce01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047fdcc0-c74e-4d3e-8821-46990cb4ce01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a97ad5-37b8-46eb-97fb-be17ca691f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:10 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Volume fef381d2-d871-4979-83a7-5003ecb01813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef381d2-d871-4979-83a7-5003ecb01813', 'volume_size': 1} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:10 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD" returned: 0 in 0.816s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] 89fa23e1-262a-416b-b193-8f71185c7514 was qcow2, converting to raw {{(pid=82057) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:10 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc Apr 24 19:16:10 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:10 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:10 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40" returned: 0 in 0.728s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:10 devstack sudo[86520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.info Apr 24 19:16:10 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:11 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.info" returned: 0 in 0.618s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:11 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:16:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:11 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.info Apr 24 19:16:11 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:12 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.info" returned: 0 in 0.650s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.622s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.884s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1921513922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef381d2-d871-4979-83a7-5003ecb01813,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16c95a36a418496d82b72a24853ffad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:10Z,use_quota=True,user_id='eee5dc05b74a4ab7bf8abd6eaa2bbe24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Creating volume fef381d2-d871-4979-83a7-5003ecb01813 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:12 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:12 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc" returned: 0 in 1.907s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_j63sg5ppdevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:16:12 devstack cinder-volume[82057]: INFO cinder.image.image_utils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Converted 112.00 MB image at 58.67 MB/s Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:12 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813 1073741824 Apr 24 19:16:12 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:12 devstack sudo[86532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc 1G Apr 24 19:16:12 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:12 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-36580658-852d-4968-8544-012f19fef140 tempest-GroupSnapshotsV319Test-876835748 None] group_snapshot 9d88040b-815d-400d-8383-578ff63c4aaf: created successfully Apr 24 19:16:12 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc 1G" returned: 0 in 0.634s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0127771-3cee-4e6d-a72d-389ce6dc4905]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:13 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813 1073741824" returned: 0 in 0.905s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:13 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc Apr 24 19:16:13 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:13 devstack sudo[86542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813 Apr 24 19:16:13 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:13 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] group_snapshot 9d88040b-815d-400d-8383-578ff63c4aaf: deleting Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] group_snapshot 9d88040b-815d-400d-8383-578ff63c4aaf: deleting {{(pid=82057) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Acquiring lock "cinder-quobyte-ce637043-2e35-4fca-af34-1eda3fe85c4b" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Lock "cinder-quobyte-ce637043-2e35-4fca-af34-1eda3fe85c4b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Acquiring lock "cinder-quobyte-4f32a6ca-3be7-4be7-9355-7945521a9e40" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Lock "cinder-quobyte-4f32a6ca-3be7-4be7-9355-7945521a9e40" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Deleting offline snapshot 4f32a6ca-3be7-4be7-9355-7945521a9e40 of volume ce637043-2e35-4fca-af34-1eda3fe85c4b {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] snapshot_file for this snap is: volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecc78e7-9203-4564-ac2d-7e6e16a134d6]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:13 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 Apr 24 19:16:13 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:13 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813" returned: 0 in 0.630s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.354s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:13 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1092543595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70c80dd-bef1-47e7-be3b-0b3882744652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ed28d21ee5403caff36fb396756fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:08Z,use_quota=True,user_id='73456118e56745bf90bf34f3cd386ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Creating volume b70c80dd-bef1-47e7-be3b-0b3882744652 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:13 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a97ad5-37b8-46eb-97fb-be17ca691f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef381d2-d871-4979-83a7-5003ecb01813', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:13 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 1073741824 Apr 24 19:16:13 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0377c971-f9fe-4fcf-9dc4-44bc1ded31fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc" returned: 0 in 0.920s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:13 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Volume volume-fef381d2-d871-4979-83a7-5003ecb01813 (fef381d2-d871-4979-83a7-5003ecb01813): created successfully Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0377c971-f9fe-4fcf-9dc4-44bc1ded31fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Flow 'volume_create_manager' (d62bf3c8-2c54-4846-8ba7-fa47fe9d1591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:13 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4138c751-874d-4479-88fb-658a1a9273dc tempest-VolumesTestJSON-1617996500 None] Created volume successfully. Apr 24 19:16:13 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc Apr 24 19:16:13 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:14 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40" returned: 0 in 0.869s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce637043-2e35-4fca-af34-1eda3fe85c4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2bc3fa-553d-4689-9f9d-9763665bc7f9]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:14 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 1073741824" returned: 0 in 0.845s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:14 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc" returned: 1 in 0.834s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:16:14 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b Apr 24 19:16:14 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Downloaded image 89fa23e1-262a-416b-b193-8f71185c7514 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}])) to volume b93bf68f-d42b-4949-ac39-353b2470c6bc successfully. {{(pid=82057) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Temporary image 89fa23e1-262a-416b-b193-8f71185c7514 for user 8d18eac849d3456db9deb51f1ee5f8b7 is deleted. {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Marking volume b93bf68f-d42b-4949-ac39-353b2470c6bc as bootable. {{(pid=82057) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Copying metadata from image 89fa23e1-262a-416b-b193-8f71185c7514 to b93bf68f-d42b-4949-ac39-353b2470c6bc. {{(pid=82057) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Creating volume glance metadata for volume b93bf68f-d42b-4949-ac39-353b2470c6bc backed by image 89fa23e1-262a-416b-b193-8f71185c7514 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82057) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:14 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 Apr 24 19:16:14 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be4e89b-b1c1-4de2-b8be-c6b37e8d278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93bf68f-d42b-4949-ac39-353b2470c6bc', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93e2bc2-62fd-4ca8-b828-70b99b78f0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:14 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Volume volume-b93bf68f-d42b-4949-ac39-353b2470c6bc (b93bf68f-d42b-4949-ac39-353b2470c6bc): created successfully Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93e2bc2-62fd-4ca8-b828-70b99b78f0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Flow 'volume_create_manager' (ff45a5d6-4e7b-4e68-bb3d-20e2cb616080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:14 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-edc1460e-733c-4a98-ace2-58a96d370d5f tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Created volume successfully. Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Flow 'volume_create_manager' (721a2b9b-c6cd-437c-ac3c-47d5d671729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a73a03-8707-4b3f-bf88-d6afc295f189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a73a03-8707-4b3f-bf88-d6afc295f189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-208579600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f1824f-bbd8-4e7d-b47d-904a83d9e808,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16c95a36a418496d82b72a24853ffad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:15Z,use_quota=True,user_id='eee5dc05b74a4ab7bf8abd6eaa2bbe24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fad1194-7fd6-43aa-90c8-16a9b4ce5b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fad1194-7fd6-43aa-90c8-16a9b4ce5b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec13163-a6f0-4c05-8bd2-452d308e5677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec13163-a6f0-4c05-8bd2-452d308e5677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3f1824f-bbd8-4e7d-b47d-904a83d9e808', 'volume_name': 'volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572af6d7-8f5f-49c0-9923-ab85a5277c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572af6d7-8f5f-49c0-9923-ab85a5277c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b101340e-7814-4e5b-9a06-2998144b5d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:15 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Volume a3f1824f-bbd8-4e7d-b47d-904a83d9e808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808', 'volume_size': 1} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652" returned: 0 in 0.634s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:15 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-208579600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f1824f-bbd8-4e7d-b47d-904a83d9e808,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16c95a36a418496d82b72a24853ffad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:15Z,use_quota=True,user_id='eee5dc05b74a4ab7bf8abd6eaa2bbe24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Creating volume a3f1824f-bbd8-4e7d-b47d-904a83d9e808 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:15 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b" returned: 0 in 0.829s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:15 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808 1073741824 Apr 24 19:16:15 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Attempting download of 89fa23e1-262a-416b-b193-8f71185c7514 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}])) to volume b70c80dd-bef1-47e7-be3b-0b3882744652. {{(pid=82057) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:16:15 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 Apr 24 19:16:15 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79c1351-06d7-4482-ac71-e4748b5e9b9a]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_fmehco3m {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:15 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_fmehco3m Apr 24 19:16:15 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:16 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808 1073741824" returned: 0 in 0.772s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:16 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_fmehco3m" returned: 0 in 0.679s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_fmehco3m {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:16 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40" returned: 0 in 0.848s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:16 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808 Apr 24 19:16:16 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:16 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40 Apr 24 19:16:16 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:16 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_fmehco3m Apr 24 19:16:16 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:16 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b.4f32a6ca-3be7-4be7-9355-7945521a9e40" returned: 0 in 0.540s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:16 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808" returned: 0 in 0.588s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Lock "cinder-quobyte-4f32a6ca-3be7-4be7-9355-7945521a9e40" released by "_delete_snapshot" :: held 3.213s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:16 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_fmehco3m" returned: 1 in 0.669s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_fmehco3m' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eff177c-31f6-4757-99fc-77693425f315]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Lock "cinder-quobyte-ce637043-2e35-4fca-af34-1eda3fe85c4b" released by "delete_snapshot" :: held 3.258s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b101340e-7814-4e5b-9a06-2998144b5d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9cfb5e-86f3-48df-a7aa-2c07e3fcf525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:16 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Volume volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808 (a3f1824f-bbd8-4e7d-b47d-904a83d9e808): created successfully Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9cfb5e-86f3-48df-a7aa-2c07e3fcf525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Flow 'volume_create_manager' (721a2b9b-c6cd-437c-ac3c-47d5d671729b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:16 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4e1f9f14-f6f3-4968-82fe-7a264308c5b8 tempest-VolumesTestJSON-1617996500 None] Created volume successfully. Apr 24 19:16:16 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD Apr 24 19:16:16 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:16 devstack cinder-volume[82057]: WARNING cinder.quota [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-244718109 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-244718109, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:16 devstack cinder-volume[82057]: WARNING cinder.quota [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-244718109 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-244718109, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:16 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] Created reservations ['6e782ac7-6f13-4ce2-b369-a2121e89ba0c', 'dc4055ca-9060-42f5-949b-d36958a3c56c', 'f389f6e3-6160-4bae-8626-81f318fa5693', 'a1389b08-5f0a-4577-8da1-367f97ab0b66'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:17 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3e81f4b8-f832-43b4-ba61-14486b7e0bad tempest-GroupSnapshotsV319Test-876835748 None] group_snapshot 9d88040b-815d-400d-8383-578ff63c4aaf: deleted successfully Apr 24 19:16:17 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD" returned: 0 in 0.678s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] 89fa23e1-262a-416b-b193-8f71185c7514 was qcow2, converting to raw {{(pid=82057) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:17 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 Apr 24 19:16:17 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Flow 'volume_create_manager' (a613b5b4-c917-4077-9a39-c93f3acbf675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0734d2-8924-4c4e-b234-8a0f2392ce76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0734d2-8924-4c4e-b234-8a0f2392ce76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1192853302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16c95a36a418496d82b72a24853ffad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:18Z,use_quota=True,user_id='eee5dc05b74a4ab7bf8abd6eaa2bbe24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0266ca70-1632-4ba8-8d95-e37d2ebfdf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0266ca70-1632-4ba8-8d95-e37d2ebfdf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3954c21d-a0ac-409b-a2a8-c326bd78b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3954c21d-a0ac-409b-a2a8-c326bd78b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353', 'volume_name': 'volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dbc1dc-36fd-426e-b3b0-cfcba320871e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dbc1dc-36fd-426e-b3b0-cfcba320871e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1409359-7043-463a-949d-15c4db7224ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:17 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Volume 3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353', 'volume_size': 1} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1192853302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='16c95a36a418496d82b72a24853ffad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:18Z,use_quota=True,user_id='eee5dc05b74a4ab7bf8abd6eaa2bbe24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Creating volume 3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:17 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:16:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:17 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353 1073741824 Apr 24 19:16:17 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Acquiring lock "cinder-quobyte-ce637043-2e35-4fca-af34-1eda3fe85c4b" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Lock "cinder-quobyte-ce637043-2e35-4fca-af34-1eda3fe85c4b" acquired by "delete_volume" :: waited 0.026s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:18 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f507c90c-906e-47d1-b960-475291b73fd4]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-ec5ae4cb-6bc7-4a21-a3ec-790e05d78e72 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:18 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b Apr 24 19:16:18 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:19 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353 1073741824" returned: 0 in 1.120s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:19 devstack sudo[86666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353 Apr 24 19:16:19 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:19 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b" returned: 0 in 0.830s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:19 devstack sudo[86668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b Apr 24 19:16:19 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:19 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652" returned: 0 in 1.916s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_198xakdrdevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:16:19 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Converted 112.00 MB image at 58.37 MB/s Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:19 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 1G Apr 24 19:16:19 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:19 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce637043-2e35-4fca-af34-1eda3fe85c4b" returned: 0 in 0.584s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Lock "cinder-quobyte-ce637043-2e35-4fca-af34-1eda3fe85c4b" released by "delete_volume" :: held 1.521s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:19 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353" returned: 0 in 0.710s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-ec5ae4cb-6bc7-4a21-a3ec-790e05d78e72 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.404s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1409359-7043-463a-949d-15c4db7224ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18fc965c-18fb-4f31-a021-ea2072b19d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[279b1c23-8b48-4f98-a3bd-ec2463d8e212]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-ec5ae4cb-6bc7-4a21-a3ec-790e05d78e72 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:19 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Volume volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353 (3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353): created successfully Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18fc965c-18fb-4f31-a021-ea2072b19d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Flow 'volume_create_manager' (a613b5b4-c917-4077-9a39-c93f3acbf675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:19 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3a09630c-6c5d-42fb-9b9a-609a45f5a31f tempest-VolumesTestJSON-1617996500 None] Created volume successfully. Apr 24 19:16:19 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Created reservations ['7a01e366-dea8-4308-88c2-3ffbf931644f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:19 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc Apr 24 19:16:19 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:20 devstack cinder-volume[82057]: WARNING cinder.quota [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-244718109 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-244718109, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Created reservations ['7f3e242d-9c0c-4a55-aed5-d31922827e0b', '7ed5b7fb-1b79-4588-a6b8-22245654e89c', '59a48fd7-53aa-4c40-9b7c-de6fbddf8e8a', '674b5dcd-2085-4d22-bdec-25484a909a00'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:20 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 1G" returned: 0 in 0.681s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[952b2e4a-1176-4522-8ca0-c848c97efe32]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:20 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:16:20 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:20 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 Apr 24 19:16:20 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:20 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-ec5ae4cb-6bc7-4a21-a3ec-790e05d78e72 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc" returned: 0 in 0.719s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-ec5ae4cb-6bc7-4a21-a3ec-790e05d78e72 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:20 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc Apr 24 19:16:20 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:20 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.542s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:20 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-fbfd91ca-4f09-4304-8397-d4461064c988 tempest-GroupSnapshotsV319Test-876835748 None] Delete group completed successfully. Apr 24 19:16:20 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652" returned: 0 in 0.686s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:21 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 Apr 24 19:16:21 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:21 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-ec5ae4cb-6bc7-4a21-a3ec-790e05d78e72 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc" returned: 1 in 1.053s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-ec5ae4cb-6bc7-4a21-a3ec-790e05d78e72 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-ec5ae4cb-6bc7-4a21-a3ec-790e05d78e72 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.845s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:21 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-ec5ae4cb-6bc7-4a21-a3ec-790e05d78e72 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596', 'name': 'volume-b93bf68f-d42b-4949-ac39-353b2470c6bc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d536562-452f-4503-9ec1-0a109f9f9d50', 'enforce_multipath': True} {{(pid=82057) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652" returned: 1 in 0.869s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Downloaded image 89fa23e1-262a-416b-b193-8f71185c7514 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}])) to volume b70c80dd-bef1-47e7-be3b-0b3882744652 successfully. {{(pid=82057) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Temporary image 89fa23e1-262a-416b-b193-8f71185c7514 for user 73456118e56745bf90bf34f3cd386ffb is deleted. {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Marking volume b70c80dd-bef1-47e7-be3b-0b3882744652 as bootable. {{(pid=82057) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Copying metadata from image 89fa23e1-262a-416b-b193-8f71185c7514 to b70c80dd-bef1-47e7-be3b-0b3882744652. {{(pid=82057) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Creating volume glance metadata for volume b70c80dd-bef1-47e7-be3b-0b3882744652 backed by image 89fa23e1-262a-416b-b193-8f71185c7514 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82057) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:16:21 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-7512ebc8-3be4-4f09-8155-5cfbc53e1f9e req-ec5ae4cb-6bc7-4a21-a3ec-790e05d78e72 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] attachment_update completed successfully. Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75eb3246-5966-4c31-8d53-4be1b5e240e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b70c80dd-bef1-47e7-be3b-0b3882744652', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bae493f-659b-4078-9b34-bf5908a14c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:21 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Volume volume-b70c80dd-bef1-47e7-be3b-0b3882744652 (b70c80dd-bef1-47e7-be3b-0b3882744652): created successfully Apr 24 19:16:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bae493f-659b-4078-9b34-bf5908a14c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:22 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Flow 'volume_create_manager' (5e1a24f1-a036-4d75-8ae1-636cb11c3179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:22 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-84b7f29b-90f7-4ca8-9e8b-010c05120e59 tempest-VolumesExtendTest-712059855 None] Created volume successfully. Apr 24 19:16:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Acquiring lock "cinder-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Lock "cinder-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Acquiring lock "cinder-quobyte-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Lock "cinder-quobyte-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353" acquired by "delete_volume" :: waited 0.065s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:22 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44ee4d9-dd32-4f77-8626-e6b89fecb965]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:22 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353 Apr 24 19:16:22 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c3dc89e-428a-430a-8fcd-cfb93472c120 tempest-VolumesExtendTest-712059855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c3dc89e-428a-430a-8fcd-cfb93472c120 tempest-VolumesExtendTest-712059855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:23 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[947591da-fd12-4234-879a-46d7fe2ccf3a]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c3dc89e-428a-430a-8fcd-cfb93472c120 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:23 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 Apr 24 19:16:23 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:23 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353" returned: 0 in 0.763s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:23 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353 Apr 24 19:16:23 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:24 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c3dc89e-428a-430a-8fcd-cfb93472c120 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652" returned: 0 in 0.797s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c3dc89e-428a-430a-8fcd-cfb93472c120 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:24 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353" returned: 0 in 0.672s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Lock "cinder-quobyte-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353" released by "delete_volume" :: held 1.493s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:24 devstack sudo[86712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 Apr 24 19:16:24 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=117,cinder:INSERT=46,cinder:UPDATE=114,cinder:DELETE=5 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Created reservations ['7ae71e60-9e79-4341-b1d6-cc09e68cc603', '6007eb34-af9e-4540-99a8-a1cb72cac63e', 'f15288e8-cadb-44c7-be63-70a6cc29e68f', '2570f30d-1c4f-4fac-8d0a-56da101a2b61'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:24 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:16:24 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:24 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c3dc89e-428a-430a-8fcd-cfb93472c120 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652" returned: 1 in 0.814s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c3dc89e-428a-430a-8fcd-cfb93472c120 tempest-VolumesExtendTest-712059855 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c3dc89e-428a-430a-8fcd-cfb93472c120 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 2G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Acquiring lock "cinder-a3f1824f-bbd8-4e7d-b47d-904a83d9e808-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Lock "cinder-a3f1824f-bbd8-4e7d-b47d-904a83d9e808-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Acquiring lock "cinder-quobyte-a3f1824f-bbd8-4e7d-b47d-904a83d9e808" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c3dc89e-428a-430a-8fcd-cfb93472c120 tempest-VolumesExtendTest-712059855 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 2G" returned: 0 in 0.138s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c3dc89e-428a-430a-8fcd-cfb93472c120 tempest-VolumesExtendTest-712059855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.804s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Lock "cinder-quobyte-a3f1824f-bbd8-4e7d-b47d-904a83d9e808" acquired by "delete_volume" :: waited 0.061s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:25 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4c3dc89e-428a-430a-8fcd-cfb93472c120 tempest-VolumesExtendTest-712059855 None] Extend volume completed successfully. Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[91956011-2e09-4c07-b0cf-0ddb9d45e2b6]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:25 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.826s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:25 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Deleted volume successfully. Apr 24 19:16:25 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808 Apr 24 19:16:25 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73414ebd-d81b-4d84-8536-9961d541db90 tempest-VolumesTestJSON-1617996500 None] Lock "cinder-3fc5c5bb-57aa-4d5f-8c4f-23a1308f4353-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Acquiring lock "cinder-b70c80dd-bef1-47e7-be3b-0b3882744652-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Lock "cinder-b70c80dd-bef1-47e7-be3b-0b3882744652-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Acquiring lock "cinder-quobyte-b70c80dd-bef1-47e7-be3b-0b3882744652" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Lock "cinder-quobyte-b70c80dd-bef1-47e7-be3b-0b3882744652" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade199f9-9832-4206-92b3-36f30d7ce5fd]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808" returned: 0 in 0.839s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:25 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:25 devstack sudo[86732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808 Apr 24 19:16:25 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:26 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 Apr 24 19:16:26 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:26 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652" returned: 0 in 0.622s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:26 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3f1824f-bbd8-4e7d-b47d-904a83d9e808" returned: 0 in 0.614s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Lock "cinder-quobyte-a3f1824f-bbd8-4e7d-b47d-904a83d9e808" released by "delete_volume" :: held 1.511s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:26 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 Apr 24 19:16:26 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:26 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Created reservations ['3ffa0bc7-9ba8-46fe-afa7-87ba7173bb6d', '5ffcecf1-8f61-4e56-a914-eaea5e1b7f2c', '2bc9e7b5-f34e-4c5a-8ef3-3d5a5c0afba2', '92915caf-ad52-483d-97c0-1f2663520544'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:26 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:16:26 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Acquiring lock "cinder-fef381d2-d871-4979-83a7-5003ecb01813-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Lock "cinder-fef381d2-d871-4979-83a7-5003ecb01813-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Acquiring lock "cinder-quobyte-fef381d2-d871-4979-83a7-5003ecb01813" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:27 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.733s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Lock "cinder-quobyte-fef381d2-d871-4979-83a7-5003ecb01813" acquired by "delete_volume" :: waited 0.040s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:27 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Deleted volume successfully. Apr 24 19:16:27 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d5b067-8ad5-4b6d-938f-b2b5a6e2b74c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652" returned: 1 in 1.038s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-13f33830-714b-4885-a113-a84419f66684 tempest-VolumesTestJSON-1617996500 None] Lock "cinder-a3f1824f-bbd8-4e7d-b47d-904a83d9e808-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:27 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652 Apr 24 19:16:27 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:27 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813 Apr 24 19:16:27 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:27 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c1a9b2b1-8df2-4262-a8f6-8553a36bf0e1 tempest-GroupsTest-1874894079 None] Group tempest-Group1-1333443559: creating Apr 24 19:16:27 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c1a9b2b1-8df2-4262-a8f6-8553a36bf0e1 tempest-GroupsTest-1874894079 None] Group tempest-Group1-1333443559: created successfully Apr 24 19:16:27 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c1a9b2b1-8df2-4262-a8f6-8553a36bf0e1 tempest-GroupsTest-1874894079 None] Create group completed successfully. Apr 24 19:16:28 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b70c80dd-bef1-47e7-be3b-0b3882744652" returned: 0 in 0.587s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Lock "cinder-quobyte-b70c80dd-bef1-47e7-be3b-0b3882744652" released by "delete_volume" :: held 2.329s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:28 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813" returned: 0 in 0.644s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:28 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813 Apr 24 19:16:28 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:28 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Created reservations ['b264db62-4853-4a62-b378-e0aa44e01c91', '7b39bc94-6d92-42f6-9bad-b2004b3df5c1', '8b91dd45-ada6-4023-95b0-53fa38de2535', 'bdef02f4-529d-40e6-b222-d30d1780416b'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:28 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:16:28 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:29 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-323a8afa-d443-4221-ae4f-867a6b9f7768 tempest-GroupsTest-1874894079 None] Group tempest-Group2-511214778: creating Apr 24 19:16:29 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-323a8afa-d443-4221-ae4f-867a6b9f7768 tempest-GroupsTest-1874894079 None] Group tempest-Group2-511214778: created successfully Apr 24 19:16:29 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-323a8afa-d443-4221-ae4f-867a6b9f7768 tempest-GroupsTest-1874894079 None] Create group completed successfully. Apr 24 19:16:29 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.994s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:29 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Deleted volume successfully. Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1a2dc2d8-9fa5-4a2c-9e54-15f4e7278e56 tempest-VolumesExtendTest-712059855 None] Lock "cinder-b70c80dd-bef1-47e7-be3b-0b3882744652-delete_volume" released by "delete_volume" :: held 3.732s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:29 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fef381d2-d871-4979-83a7-5003ecb01813" returned: 0 in 1.327s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Lock "cinder-quobyte-fef381d2-d871-4979-83a7-5003ecb01813" released by "delete_volume" :: held 2.071s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Created reservations ['194feb6f-b37d-4a8b-be05-dfb1882326c9', 'f65cdc81-0fc8-4861-8e0d-2c9030453781', '431555e0-0c15-4402-8c37-87c0dd75867f', 'b8522984-e0ff-42a7-a4a7-45559ae3d238'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:29 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:16:29 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Flow 'volume_create_manager' (465a0e0d-f92e-4880-9985-50d03ae2cf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594aba4c-e255-40ed-bda9-0bc21d2c2121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594aba4c-e255-40ed-bda9-0bc21d2c2121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-92168798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8f2617-7acc-463b-829c-596013d9a324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ed28d21ee5403caff36fb396756fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:30Z,use_quota=True,user_id='73456118e56745bf90bf34f3cd386ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d909c673-6a7e-4c29-b816-bf9d12195a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d909c673-6a7e-4c29-b816-bf9d12195a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602e3b3d-0076-4f5f-bfb9-33cee4124bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602e3b3d-0076-4f5f-bfb9-33cee4124bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c8f2617-7acc-463b-829c-596013d9a324', 'volume_name': 'volume-3c8f2617-7acc-463b-829c-596013d9a324', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c035c3ce-4bdf-46fc-b417-10a7e3910765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c035c3ce-4bdf-46fc-b417-10a7e3910765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cd6582-03d9-4627-970f-d8a287ff385b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:29 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Volume 3c8f2617-7acc-463b-829c-596013d9a324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c8f2617-7acc-463b-829c-596013d9a324', 'volume_size': 1} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-92168798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8f2617-7acc-463b-829c-596013d9a324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ed28d21ee5403caff36fb396756fba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:30Z,use_quota=True,user_id='73456118e56745bf90bf34f3cd386ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Creating volume 3c8f2617-7acc-463b-829c-596013d9a324 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:29 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:16:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:30 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 1073741824 Apr 24 19:16:30 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:30 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.784s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:30 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:30 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Deleted volume successfully. Apr 24 19:16:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-63950a18-b6e0-4145-80d0-682c0cb3884d tempest-VolumesTestJSON-1617996500 None] Lock "cinder-fef381d2-d871-4979-83a7-5003ecb01813-delete_volume" released by "delete_volume" :: held 3.409s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:31 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Flow 'volume_create_manager' (151e07da-4f87-4a4f-b59a-6566e0ef5a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f6863e-0c9b-4560-8219-30c07bcf8248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 1073741824" returned: 0 in 1.707s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f6863e-0c9b-4560-8219-30c07bcf8248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-690730201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6232df62-365f-4280-b17f-1f565756b2ea,host='devstack@QuobyteHD#QuobyteHD',id=b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1a640f98b4ffda0457abb21fba34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:31Z,use_quota=True,user_id='648600c88f134e76a7d6a2facd81f1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8a8fcee-fb34-4415-b0ff-7c3a570f3165),volume_type_id=c8a8fcee-fb34-4415-b0ff-7c3a570f3165)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a3a27e-e2e4-4347-a999-880487ef3846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a3a27e-e2e4-4347-a999-880487ef3846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980639a6-30f7-4970-9ee3-43f55e21c960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (980639a6-30f7-4970-9ee3-43f55e21c960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b', 'volume_name': 'volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43586498-b2ca-4d82-8bfc-201f25b5c661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43586498-b2ca-4d82-8bfc-201f25b5c661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4733af1d-cd83-4e1c-8e48-fc3ac33e7c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:31 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Volume b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b', 'volume_size': 1} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:31 devstack sudo[86815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 Apr 24 19:16:31 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:32 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324" returned: 0 in 1.009s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] <== create_volume: return (2842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.844s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.083s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6232df62-365f-4280-b17f-1f565756b2ea,created_at=2026-04-24T17:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-690730201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6232df62-365f-4280-b17f-1f565756b2ea,host='devstack@QuobyteHD#QuobyteHD',id=b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1a640f98b4ffda0457abb21fba34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:31Z,use_quota=True,user_id='648600c88f134e76a7d6a2facd81f1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8a8fcee-fb34-4415-b0ff-7c3a570f3165),volume_type_id=c8a8fcee-fb34-4415-b0ff-7c3a570f3165)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Creating volume b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:32 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cd6582-03d9-4627-970f-d8a287ff385b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8f2617-7acc-463b-829c-596013d9a324', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554ef7b3-1be5-493d-93ed-f318f54fdc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:32 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Volume volume-3c8f2617-7acc-463b-829c-596013d9a324 (3c8f2617-7acc-463b-829c-596013d9a324): created successfully Apr 24 19:16:32 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b 1073741824 Apr 24 19:16:32 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (554ef7b3-1be5-493d-93ed-f318f54fdc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Flow 'volume_create_manager' (465a0e0d-f92e-4880-9985-50d03ae2cf3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:32 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-32726a88-13da-4669-9876-d84731760daf tempest-VolumesExtendTest-712059855 None] Created volume successfully. Apr 24 19:16:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:34 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b 1073741824" returned: 0 in 1.608s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:34 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b Apr 24 19:16:34 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:35 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b" returned: 0 in 0.853s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:35 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] <== create_volume: return (2525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.537s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.624s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4733af1d-cd83-4e1c-8e48-fc3ac33e7c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f914f60-dab0-4740-9cf0-2b45d8fb9a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:35 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] Creating offline snapshot e854a6ea-0949-4447-8c7c-795455eed11c of volume 3c8f2617-7acc-463b-829c-596013d9a324 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:16:35 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Volume volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b (b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b): created successfully Apr 24 19:16:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f914f60-dab0-4740-9cf0-2b45d8fb9a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Flow 'volume_create_manager' (151e07da-4f87-4a4f-b59a-6566e0ef5a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:35 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[63de2ec8-6ec6-4770-a7e4-16dfb30cb1dd]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:35 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-db1185e8-4d0d-4c70-b9d9-58dd5d9e1d83 tempest-GroupsTest-1874894079 None] Created volume successfully. Apr 24 19:16:35 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 Apr 24 19:16:35 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:36 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324" returned: 0 in 1.003s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:36 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c 1G Apr 24 19:16:36 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:36 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Acquiring lock "cinder-quobyte-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Lock "cinder-quobyte-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b" acquired by "delete_volume" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:37 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ee30f-6889-4803-a8d1-2b5a449c4980]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:37 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b Apr 24 19:16:37 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:37 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c 1G" returned: 0 in 0.858s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c8f2617-7acc-463b-829c-596013d9a324 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:37 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c8f2617-7acc-463b-829c-596013d9a324 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c Apr 24 19:16:37 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6c9ee730-a023-4de1-a796-ba7ae8337bd5 tempest-BackendsCapabilitiesAdminTestsJSON-606993165 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7242012023926, 'free_capacity_gb': 1775.7242012023926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82057) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 19:16:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c6588250-668e-4b0c-8ff5-49806a897778 tempest-BackendsCapabilitiesAdminTestsJSON-606993165 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7242012023926, 'free_capacity_gb': 1775.7242012023926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82057) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 19:16:37 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b" returned: 0 in 0.752s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:37 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b Apr 24 19:16:37 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:37 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c8f2617-7acc-463b-829c-596013d9a324 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c" returned: 0 in 0.547s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:37 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c is being set with open permissions: ugo+rw Apr 24 19:16:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:37 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c Apr 24 19:16:37 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:38 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c" returned: 0 in 0.646s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:38 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.info Apr 24 19:16:38 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:38 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b" returned: 0 in 0.925s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Lock "cinder-quobyte-b9ac9370-bbc3-4e3c-a15d-7cd91a6a6d3b" released by "delete_volume" :: held 1.764s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:38 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Created reservations ['f695dddf-5895-45ad-9892-27598aea3e8b'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:38 devstack cinder-volume[82057]: WARNING cinder.quota [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-210219333 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-210219333, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:38 devstack cinder-volume[82057]: WARNING cinder.quota [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-210219333 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-210219333, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:38 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Created reservations ['c69552cd-7a7c-4b9c-a154-0ab79d4e02f7', 'b7dd22eb-380b-4480-a288-f3bfd5abf78a', '773e0d48-3860-40f4-a539-338bb22ba2ae', '6ea09f77-5f94-4bce-a105-d54ddb82190f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:39 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:16:39 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:39 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.info" returned: 0 in 0.760s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:39 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.info is being set with open permissions: ugo+rw Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:39 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.info Apr 24 19:16:39 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-b1baa9ea-bec4-4014-8929-5d95c67f66b6 tempest-GroupsTest-1874894079 None] Created reservations ['1c7fc574-fab4-4b45-be26-fe296bfa2264'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b1baa9ea-bec4-4014-8929-5d95c67f66b6 tempest-GroupsTest-1874894079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b1baa9ea-bec4-4014-8929-5d95c67f66b6 tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b1baa9ea-bec4-4014-8929-5d95c67f66b6 tempest-GroupsTest-1874894079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b1baa9ea-bec4-4014-8929-5d95c67f66b6 tempest-GroupsTest-1874894079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b1baa9ea-bec4-4014-8929-5d95c67f66b6 tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b1baa9ea-bec4-4014-8929-5d95c67f66b6 tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:39 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:16:39 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:39 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.691s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:39 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:39 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d901898a-9c53-430d-89b4-fdf6a6e4cda3 tempest-GroupsTest-1874894079 None] Delete group completed successfully. Apr 24 19:16:40 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.info" returned: 0 in 0.813s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.847s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:40 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6bbbde90-e91e-4394-a937-68b2a86ec627 tempest-VolumesExtendTest-712059855 None] Create snapshot completed successfully Apr 24 19:16:40 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b1baa9ea-bec4-4014-8929-5d95c67f66b6 tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.957s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:40 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-b1baa9ea-bec4-4014-8929-5d95c67f66b6 tempest-GroupsTest-1874894079 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:40 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-b1baa9ea-bec4-4014-8929-5d95c67f66b6 tempest-GroupsTest-1874894079 None] Delete group completed successfully. Apr 24 19:16:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0e620de8-b216-4b93-ae69-b7133b379e7a tempest-VolumesExtendTest-712059855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0e620de8-b216-4b93-ae69-b7133b379e7a tempest-VolumesExtendTest-712059855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:40 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa3de5d-5f95-4c8e-8011-139eae1628bd]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0e620de8-b216-4b93-ae69-b7133b379e7a tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:40 devstack sudo[86899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 Apr 24 19:16:40 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:41 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1f11e809-5f24-4fcc-8229-0c84ed412145 tempest-GroupsTest-1874894079 None] Group tempest-GroupsTest-Group-864209003: creating Apr 24 19:16:41 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1f11e809-5f24-4fcc-8229-0c84ed412145 tempest-GroupsTest-1874894079 None] Group tempest-GroupsTest-Group-864209003: created successfully Apr 24 19:16:41 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1f11e809-5f24-4fcc-8229-0c84ed412145 tempest-GroupsTest-1874894079 None] Create group completed successfully. Apr 24 19:16:41 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0e620de8-b216-4b93-ae69-b7133b379e7a tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324" returned: 0 in 0.953s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0e620de8-b216-4b93-ae69-b7133b379e7a tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c 2G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0e620de8-b216-4b93-ae69-b7133b379e7a tempest-VolumesExtendTest-712059855 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c 2G" returned: 0 in 0.229s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0e620de8-b216-4b93-ae69-b7133b379e7a tempest-VolumesExtendTest-712059855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.218s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:42 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0e620de8-b216-4b93-ae69-b7133b379e7a tempest-VolumesExtendTest-712059855 None] Extend volume completed successfully. Apr 24 19:16:42 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Flow 'volume_create_manager' (b76acc62-3497-49a6-8080-b8b16ba80df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177ff2bc-2e66-46d8-917b-3de6549b1773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177ff2bc-2e66-46d8-917b-3de6549b1773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1635435120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=641538ca-0752-44e9-810c-5e4e62a4b665,host='devstack@QuobyteHD#QuobyteHD',id=4beb9b83-d717-4c2f-8e6a-3be4d115911c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1a640f98b4ffda0457abb21fba34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:43Z,use_quota=True,user_id='648600c88f134e76a7d6a2facd81f1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89e7a63a-736e-4d1a-877e-447538b4c194),volume_type_id=89e7a63a-736e-4d1a-877e-447538b4c194)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2134627d-570a-43f0-b820-923ac0928bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2134627d-570a-43f0-b820-923ac0928bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd15ba2f-50d2-4c94-a1ff-025fba1f8dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd15ba2f-50d2-4c94-a1ff-025fba1f8dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4beb9b83-d717-4c2f-8e6a-3be4d115911c', 'volume_name': 'volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c42ed5-29e7-4c65-80e7-539e66314a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c42ed5-29e7-4c65-80e7-539e66314a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7beb0d8a-0929-4c35-889e-5404b8a2a5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:43 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Volume 4beb9b83-d717-4c2f-8e6a-3be4d115911c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c', 'volume_size': 1} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=641538ca-0752-44e9-810c-5e4e62a4b665,created_at=2026-04-24T17:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1635435120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=641538ca-0752-44e9-810c-5e4e62a4b665,host='devstack@QuobyteHD#QuobyteHD',id=4beb9b83-d717-4c2f-8e6a-3be4d115911c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1a640f98b4ffda0457abb21fba34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:43Z,use_quota=True,user_id='648600c88f134e76a7d6a2facd81f1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89e7a63a-736e-4d1a-877e-447538b4c194),volume_type_id=89e7a63a-736e-4d1a-877e-447538b4c194)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Creating volume 4beb9b83-d717-4c2f-8e6a-3be4d115911c {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:43 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:43 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c 1073741824 Apr 24 19:16:43 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Acquiring lock "cinder-e854a6ea-0949-4447-8c7c-795455eed11c-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Lock "cinder-e854a6ea-0949-4447-8c7c-795455eed11c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Acquiring lock "cinder-quobyte-3c8f2617-7acc-463b-829c-596013d9a324" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Lock "cinder-quobyte-3c8f2617-7acc-463b-829c-596013d9a324" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Acquiring lock "cinder-quobyte-e854a6ea-0949-4447-8c7c-795455eed11c" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Lock "cinder-quobyte-e854a6ea-0949-4447-8c7c-795455eed11c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Deleting offline snapshot e854a6ea-0949-4447-8c7c-795455eed11c of volume 3c8f2617-7acc-463b-829c-596013d9a324 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] snapshot_file for this snap is: volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b05705-091b-4c9e-a586-48362e981dc2]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:43 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c Apr 24 19:16:43 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:44 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c 1073741824" returned: 0 in 1.049s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:44 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c Apr 24 19:16:44 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:44 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c" returned: 0 in 0.921s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c8f2617-7acc-463b-829c-596013d9a324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03ddbd7-95de-4826-9061-f2e339a4fd9a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:44 devstack sudo[86938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 Apr 24 19:16:44 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:44 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c" returned: 0 in 0.738s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7beb0d8a-0929-4c35-889e-5404b8a2a5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9351ed38-3de1-4b30-bde1-2f6b718be726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:44 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Volume volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c (4beb9b83-d717-4c2f-8e6a-3be4d115911c): created successfully Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9351ed38-3de1-4b30-bde1-2f6b718be726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Flow 'volume_create_manager' (b76acc62-3497-49a6-8080-b8b16ba80df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:44 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7344123f-6f3a-4bd1-a6c1-39dfe2c57e4e tempest-GroupsTest-1874894079 None] Created volume successfully. Apr 24 19:16:45 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324" returned: 0 in 0.760s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:45 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c Apr 24 19:16:45 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Flow 'volume_create_manager' (52a124be-f6fe-419b-8822-3ea180e7cf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4299fe16-004c-47ba-8a13-40ad3431fdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4299fe16-004c-47ba-8a13-40ad3431fdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1969392883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=641538ca-0752-44e9-810c-5e4e62a4b665,host='devstack@QuobyteHD#QuobyteHD',id=158387ba-03bb-4ad1-ad93-afa3a93f8a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1a640f98b4ffda0457abb21fba34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:46Z,use_quota=True,user_id='648600c88f134e76a7d6a2facd81f1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89e7a63a-736e-4d1a-877e-447538b4c194),volume_type_id=89e7a63a-736e-4d1a-877e-447538b4c194)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb948a5-2cef-4e9e-a903-f4cbabd7d5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb948a5-2cef-4e9e-a903-f4cbabd7d5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dce7208-d49f-4d96-abb8-59bbb7a565a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dce7208-d49f-4d96-abb8-59bbb7a565a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158387ba-03bb-4ad1-ad93-afa3a93f8a38', 'volume_name': 'volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df71661d-8674-456a-8181-7f1542528970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df71661d-8674-456a-8181-7f1542528970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd02a72-8d0f-4517-b553-7ccfc168b770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:45 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Volume 158387ba-03bb-4ad1-ad93-afa3a93f8a38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38', 'volume_size': 1} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=641538ca-0752-44e9-810c-5e4e62a4b665,created_at=2026-04-24T17:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1969392883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=641538ca-0752-44e9-810c-5e4e62a4b665,host='devstack@QuobyteHD#QuobyteHD',id=158387ba-03bb-4ad1-ad93-afa3a93f8a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86d1a640f98b4ffda0457abb21fba34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:46Z,use_quota=True,user_id='648600c88f134e76a7d6a2facd81f1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89e7a63a-736e-4d1a-877e-447538b4c194),volume_type_id=89e7a63a-736e-4d1a-877e-447538b4c194)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Creating volume 158387ba-03bb-4ad1-ad93-afa3a93f8a38 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:45 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:16:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:45 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38 1073741824 Apr 24 19:16:46 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:46 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c" returned: 0 in 1.012s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:46 devstack sudo[86957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c Apr 24 19:16:46 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:46 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38 1073741824" returned: 0 in 0.956s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:46 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324.e854a6ea-0949-4447-8c7c-795455eed11c" returned: 0 in 0.860s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Lock "cinder-quobyte-e854a6ea-0949-4447-8c7c-795455eed11c" released by "_delete_snapshot" :: held 3.710s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Lock "cinder-quobyte-3c8f2617-7acc-463b-829c-596013d9a324" released by "delete_snapshot" :: held 3.752s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:47 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38 Apr 24 19:16:47 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Created reservations ['6696f7e2-6c90-4fec-a947-e541f672133b', 'c52346b4-d182-45b9-a96f-ab0109c460d6', 'bacbeaa5-203f-4ef2-b7a5-45ed517f3bfa', '7ecc2f39-10fd-451c-8703-fefba8bb1f7c'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:47 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Delete snapshot completed successfully. Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-906cd26d-7b97-474e-90c6-cee2d120a2b9 tempest-VolumesExtendTest-712059855 None] Lock "cinder-e854a6ea-0949-4447-8c7c-795455eed11c-delete_snapshot" released by "delete_snapshot" :: held 4.102s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:47 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38" returned: 0 in 0.810s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd02a72-8d0f-4517-b553-7ccfc168b770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5a06fd-6192-4640-9427-ce486ae7b596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:47 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Volume volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38 (158387ba-03bb-4ad1-ad93-afa3a93f8a38): created successfully Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b5a06fd-6192-4640-9427-ce486ae7b596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Flow 'volume_create_manager' (52a124be-f6fe-419b-8822-3ea180e7cf82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:47 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c256562a-2d5e-4cf5-adb5-488f91b442bb tempest-GroupsTest-1874894079 None] Created volume successfully. Apr 24 19:16:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Acquiring lock "cinder-3c8f2617-7acc-463b-829c-596013d9a324-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Lock "cinder-3c8f2617-7acc-463b-829c-596013d9a324-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Acquiring lock "cinder-quobyte-3c8f2617-7acc-463b-829c-596013d9a324" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Lock "cinder-quobyte-3c8f2617-7acc-463b-829c-596013d9a324" acquired by "delete_volume" :: waited 0.039s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:48 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86e3272-114b-485c-8042-98d825571136]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:48 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 Apr 24 19:16:48 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:48 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-aac7e61b-fdc7-40e6-8ed0-8804b06a2477 tempest-GroupsTest-1874894079 None] Update group completed successfully. Apr 24 19:16:49 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324" returned: 0 in 1.150s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:49 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324 Apr 24 19:16:49 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:50 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3ae32c6d-ce5a-4210-b0e0-a1164e332105 tempest-GroupsTest-1874894079 None] Update group completed successfully. Apr 24 19:16:50 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3c8f2617-7acc-463b-829c-596013d9a324" returned: 0 in 1.096s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Lock "cinder-quobyte-3c8f2617-7acc-463b-829c-596013d9a324" released by "delete_volume" :: held 2.394s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:50 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Created reservations ['e6a9d8fe-f41d-4629-b875-f7253599f83e', '206eb9ad-a191-4a11-b7b0-64a82c852b39', '93b10258-3326-4f09-90d9-78c89550c9ef', 'b2c9f2db-6cd4-4974-9c67-23c5ea561dfb'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:50 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:16:50 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:52 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.261s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:52 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:52 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Deleted volume successfully. Apr 24 19:16:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1b2e23ef-5692-438b-839f-29e3d55f0e71 tempest-VolumesExtendTest-712059855 None] Lock "cinder-3c8f2617-7acc-463b-829c-596013d9a324-delete_volume" released by "delete_volume" :: held 4.018s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Acquiring lock "cinder-quobyte-158387ba-03bb-4ad1-ad93-afa3a93f8a38" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Lock "cinder-quobyte-158387ba-03bb-4ad1-ad93-afa3a93f8a38" acquired by "delete_volume" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:52 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e175d7e8-017b-4951-b223-6de876360769]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:52 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38 Apr 24 19:16:52 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:53 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38" returned: 0 in 0.857s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:53 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38 Apr 24 19:16:53 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:54 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-158387ba-03bb-4ad1-ad93-afa3a93f8a38" returned: 0 in 1.145s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Lock "cinder-quobyte-158387ba-03bb-4ad1-ad93-afa3a93f8a38" released by "delete_volume" :: held 2.070s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Acquiring lock "cinder-quobyte-4beb9b83-d717-4c2f-8e6a-3be4d115911c" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:16:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Lock "cinder-quobyte-4beb9b83-d717-4c2f-8e6a-3be4d115911c" acquired by "delete_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:16:54 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aea069c-2a59-4e06-bb50-c999a0946487]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:16:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:54 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c Apr 24 19:16:54 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Flow 'volume_create_manager' (8f8385fd-b389-49b0-a23c-269619946611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e145684-4ef4-4112-a397-c1379fea4a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e145684-4ef4-4112-a397-c1379fea4a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-123922143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ecf712-7a91-4175-8199-15307188f483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc40de8c4444ffd8ac94bcfaf102cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:55Z,use_quota=True,user_id='e90a3c39231d4e1cbe60900a49b69823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18d5ce4c-55b2-47d2-8990-26fa740aea3f),volume_type_id=18d5ce4c-55b2-47d2-8990-26fa740aea3f)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7215d6-5f5b-4fc1-8893-df16d34ff4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7215d6-5f5b-4fc1-8893-df16d34ff4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2948579d-043a-427f-b0c1-9003d8bc7630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2948579d-043a-427f-b0c1-9003d8bc7630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ecf712-7a91-4175-8199-15307188f483', 'volume_name': 'volume-c9ecf712-7a91-4175-8199-15307188f483', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a359afc0-26b8-414f-b74f-4bc74832a450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a359afc0-26b8-414f-b74f-4bc74832a450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12b30e5-b4a1-4c10-9ab9-01d7c18b6725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:55 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Volume c9ecf712-7a91-4175-8199-15307188f483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ecf712-7a91-4175-8199-15307188f483', 'volume_size': 1} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-123922143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ecf712-7a91-4175-8199-15307188f483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc40de8c4444ffd8ac94bcfaf102cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:16:55Z,use_quota=True,user_id='e90a3c39231d4e1cbe60900a49b69823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18d5ce4c-55b2-47d2-8990-26fa740aea3f),volume_type_id=18d5ce4c-55b2-47d2-8990-26fa740aea3f)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Creating volume c9ecf712-7a91-4175-8199-15307188f483 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:16:55 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:55 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c" returned: 0 in 0.987s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:55 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483 1073741824 Apr 24 19:16:55 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:55 devstack sudo[87093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c Apr 24 19:16:55 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:56 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4beb9b83-d717-4c2f-8e6a-3be4d115911c" returned: 0 in 0.772s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Lock "cinder-quobyte-4beb9b83-d717-4c2f-8e6a-3be4d115911c" released by "delete_volume" :: held 1.822s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:16:56 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=137,cinder:INSERT=32,cinder:UPDATE=133,cinder:DELETE=8 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:16:56 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483 1073741824" returned: 0 in 1.074s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:56 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Created reservations ['5270fe06-18ec-439c-9078-86532f700116'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:56 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483 Apr 24 19:16:56 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:56 devstack cinder-volume[82057]: WARNING cinder.quota [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1950505331 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1950505331, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:56 devstack cinder-volume[82057]: WARNING cinder.quota [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1950505331 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1950505331, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:16:56 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Created reservations ['5710baf1-393d-41b4-9ab4-b8f16febd3d1', 'f3336c77-15bf-4a2b-88b4-953308ce0472', '20589d89-551d-4811-9e99-0515038774b9', '006a8240-e48b-4bb5-b33e-da0a3416fc5b'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:56 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Created reservations ['71bd271c-d000-4fdb-821a-d467818f30fc', 'b9de4c07-1371-4135-b7f2-2ac55b58d45d', 'cf96754c-7d85-4749-9cc7-7c0762ba0206', '38ab52c0-fd41-4dc3-8525-d586b5e73e45'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:57 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:16:57 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:57 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483" returned: 0 in 1.174s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.358s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12b30e5-b4a1-4c10-9ab9-01d7c18b6725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ecf712-7a91-4175-8199-15307188f483', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1d372d-7a86-4fe1-bf55-a6721e90117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:16:57 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Volume volume-c9ecf712-7a91-4175-8199-15307188f483 (c9ecf712-7a91-4175-8199-15307188f483): created successfully Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1d372d-7a86-4fe1-bf55-a6721e90117d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:16:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Flow 'volume_create_manager' (8f8385fd-b389-49b0-a23c-269619946611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:16:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-5f411479-1b20-4ab4-9d03-0aa380ebf693 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Created volume successfully. Apr 24 19:16:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:16:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:16:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:16:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:16:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:16:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:16:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:16:58 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:16:58 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:16:58 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 24 19:16:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.370s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:16:58 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:16:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3d629892-c838-4f2b-991b-813a75ffdf5b tempest-GroupsTest-1874894079 None] Delete group completed successfully. Apr 24 19:17:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6d4fc5c3-fc12-470b-a181-72f19943c375 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6d4fc5c3-fc12-470b-a181-72f19943c375 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fc5c3-fc12-470b-a181-72f19943c375 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6d4fc5c3-fc12-470b-a181-72f19943c375 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6d4fc5c3-fc12-470b-a181-72f19943c375 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6d4fc5c3-fc12-470b-a181-72f19943c375 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:00 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:17:00 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:00 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 2.206s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:00 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:01 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6d4fc5c3-fc12-470b-a181-72f19943c375 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.924s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:01 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-6d4fc5c3-fc12-470b-a181-72f19943c375 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6d4fc5c3-fc12-470b-a181-72f19943c375 tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Retype volume completed successfully. Apr 24 19:17:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Acquiring lock "cinder-c9ecf712-7a91-4175-8199-15307188f483-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "cinder-c9ecf712-7a91-4175-8199-15307188f483-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Acquiring lock "cinder-quobyte-c9ecf712-7a91-4175-8199-15307188f483" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "cinder-quobyte-c9ecf712-7a91-4175-8199-15307188f483" acquired by "delete_volume" :: waited 0.035s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00e57b9-b6d4-489e-93ac-d0059f829bd2]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:02 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483 Apr 24 19:17:02 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Flow 'volume_create_manager' (3bec3c11-4596-4afb-aa07-68af788874f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19898a75-da4b-4ffc-8261-4015bdb5cac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19898a75-da4b-4ffc-8261-4015bdb5cac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1802483763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69669509-357c-4df2-9755-1de05bdfba57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ff8dd0013c4a28b35197b7e7ed39c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:03Z,use_quota=True,user_id='14df2e1346784cf6a4bb02cfcfb51aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3129cd-e085-4e42-9abc-92fedea62a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3129cd-e085-4e42-9abc-92fedea62a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3590c866-452d-42c2-b254-f26a62494d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3590c866-452d-42c2-b254-f26a62494d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69669509-357c-4df2-9755-1de05bdfba57', 'volume_name': 'volume-69669509-357c-4df2-9755-1de05bdfba57', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94404689-6f47-445e-959d-00552e166688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94404689-6f47-445e-959d-00552e166688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4692b045-11ca-446b-82bb-d160a7444f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:02 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Volume 69669509-357c-4df2-9755-1de05bdfba57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69669509-357c-4df2-9755-1de05bdfba57', 'volume_size': 1} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1802483763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69669509-357c-4df2-9755-1de05bdfba57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ff8dd0013c4a28b35197b7e7ed39c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:03Z,use_quota=True,user_id='14df2e1346784cf6a4bb02cfcfb51aae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Creating volume 69669509-357c-4df2-9755-1de05bdfba57 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:02 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:02 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57 1073741824 Apr 24 19:17:02 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:02 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483" returned: 0 in 0.926s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:02 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483 Apr 24 19:17:02 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:03 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c9ecf712-7a91-4175-8199-15307188f483" returned: 0 in 0.904s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:03 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "cinder-quobyte-c9ecf712-7a91-4175-8199-15307188f483" released by "delete_volume" :: held 1.903s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:03 devstack cinder-volume[82057]: WARNING cinder.quota [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:17:03 devstack cinder-volume[82057]: WARNING cinder.quota [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:17:03 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Created reservations ['1567aa37-f110-4cc8-8381-bd6a08392171', '1cde7593-2572-4707-87ef-100753bcf76d', '76d7caa3-a01e-4b44-88da-2c6128df6ea9', '94ac9a55-c5ee-45e3-83e3-f3f7f5f5fdbc'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:03 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57 1073741824" returned: 0 in 1.084s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:04 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57 Apr 24 19:17:04 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:04 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:17:04 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:04 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-d244cbb6-6223-4210-9ca4-31a383532769 req-857deb8f-7842-486f-95de-8c53c8c34d09 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Terminate volume connection completed successfully. Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-d244cbb6-6223-4210-9ca4-31a383532769 req-857deb8f-7842-486f-95de-8c53c8c34d09 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Deleting attachment 1d536562-452f-4503-9ec1-0a109f9f9d50. {{(pid=82057) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:17:04 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.681s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:04 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Deleted volume successfully. Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bb524da7-863d-4ae8-8857-766406e4869d tempest-VolumeRetypeWithoutMigrationTest-860763332 None] Lock "cinder-c9ecf712-7a91-4175-8199-15307188f483-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:04 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57" returned: 0 in 0.807s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4692b045-11ca-446b-82bb-d160a7444f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69669509-357c-4df2-9755-1de05bdfba57', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2afd83-1538-4f80-b2ac-c6019af5d4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:04 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Volume volume-69669509-357c-4df2-9755-1de05bdfba57 (69669509-357c-4df2-9755-1de05bdfba57): created successfully Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2afd83-1538-4f80-b2ac-c6019af5d4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Flow 'volume_create_manager' (3bec3c11-4596-4afb-aa07-68af788874f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:04 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-a51a2ffc-bddc-451a-8221-25d1c5d578dd tempest-VolumesNegativeTest-30219490 None] Created volume successfully. Apr 24 19:17:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "cinder-b93bf68f-d42b-4949-ac39-353b2470c6bc-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "cinder-b93bf68f-d42b-4949-ac39-353b2470c6bc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "cinder-quobyte-b93bf68f-d42b-4949-ac39-353b2470c6bc" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "cinder-quobyte-b93bf68f-d42b-4949-ac39-353b2470c6bc" acquired by "delete_volume" :: waited 0.028s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:05 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e16921-8f51-438c-aca6-ba5ae57a0522]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:05 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc Apr 24 19:17:05 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:06 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc" returned: 0 in 0.915s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:06 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc Apr 24 19:17:06 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:07 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc" returned: 1 in 1.125s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:17:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:07 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc Apr 24 19:17:07 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:08 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b93bf68f-d42b-4949-ac39-353b2470c6bc" returned: 0 in 0.795s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "cinder-quobyte-b93bf68f-d42b-4949-ac39-353b2470c6bc" released by "delete_volume" :: held 2.935s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:08 devstack cinder-volume[82057]: DEBUG cinder.quota [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Created reservations ['7f0473c4-d4da-41c5-ba8b-20378356890b', '5aa82565-bf83-42d5-9469-c8eb2859cd7a', '54364b28-c84f-4af9-b6e1-60c54696fafa', '3db9c055-a962-4c85-90b6-cf542b3563e9'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:08 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7204d37d-d764-4795-9b16-7e924d4abc06 tempest-GroupsV314Test-1171390860 None] Group tempest-GroupsV314Test-Group-1951774730: creating Apr 24 19:17:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:08 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7204d37d-d764-4795-9b16-7e924d4abc06 tempest-GroupsV314Test-1171390860 None] Group tempest-GroupsV314Test-Group-1951774730: created successfully Apr 24 19:17:08 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:17:08 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:08 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7204d37d-d764-4795-9b16-7e924d4abc06 tempest-GroupsV314Test-1171390860 None] Create group completed successfully. Apr 24 19:17:09 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.699s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:09 devstack cinder-volume[82057]: DEBUG cinder.manager [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:09 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Deleted volume successfully. Apr 24 19:17:09 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-d244cbb6-6223-4210-9ca4-31a383532769 req-b6a774c1-1efa-45dc-aa44-5708b56b6efc tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "cinder-b93bf68f-d42b-4949-ac39-353b2470c6bc-delete_volume" released by "delete_volume" :: held 4.068s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Flow 'volume_create_manager' (463ab79d-2466-4119-b660-f1e24f172865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fd9d65-a0d0-44df-bef4-4fb9eddf86bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fd9d65-a0d0-44df-bef4-4fb9eddf86bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-565552840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2fff0ea3-7a01-47d7-94ec-6fe6c025b443,host='devstack@QuobyteHD#QuobyteHD',id=a90bf0ae-06a3-4e92-8be3-01644e36798d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d9bf3d28fd45be957a8163b2f84092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:10Z,use_quota=True,user_id='68f97f82b1a748d08751d1c8c8632083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae5b3579-d631-4381-90dd-bfa3791a3d49),volume_type_id=ae5b3579-d631-4381-90dd-bfa3791a3d49)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c699132-8153-4137-bd04-a9fc5c6c2be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c699132-8153-4137-bd04-a9fc5c6c2be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1077f011-a4c5-4578-91dc-532f0b2863b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1077f011-a4c5-4578-91dc-532f0b2863b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90bf0ae-06a3-4e92-8be3-01644e36798d', 'volume_name': 'volume-a90bf0ae-06a3-4e92-8be3-01644e36798d', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d457416e-75bf-4cf5-919e-21bc78d53aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d457416e-75bf-4cf5-919e-21bc78d53aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd00428-e7f2-4405-9050-d682142fef94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:10 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Volume a90bf0ae-06a3-4e92-8be3-01644e36798d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90bf0ae-06a3-4e92-8be3-01644e36798d', 'volume_size': 1} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2fff0ea3-7a01-47d7-94ec-6fe6c025b443,created_at=2026-04-24T17:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-565552840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2fff0ea3-7a01-47d7-94ec-6fe6c025b443,host='devstack@QuobyteHD#QuobyteHD',id=a90bf0ae-06a3-4e92-8be3-01644e36798d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d9bf3d28fd45be957a8163b2f84092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:10Z,use_quota=True,user_id='68f97f82b1a748d08751d1c8c8632083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae5b3579-d631-4381-90dd-bfa3791a3d49),volume_type_id=ae5b3579-d631-4381-90dd-bfa3791a3d49)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Creating volume a90bf0ae-06a3-4e92-8be3-01644e36798d {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:10 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:17:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:10 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d 1073741824 Apr 24 19:17:10 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:11 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d 1073741824" returned: 0 in 1.282s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:11 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d Apr 24 19:17:11 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:12 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d" returned: 0 in 0.663s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd00428-e7f2-4405-9050-d682142fef94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90bf0ae-06a3-4e92-8be3-01644e36798d', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77293764-f92e-4de9-8f98-42b8eda62a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:12 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Volume volume-a90bf0ae-06a3-4e92-8be3-01644e36798d (a90bf0ae-06a3-4e92-8be3-01644e36798d): created successfully Apr 24 19:17:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77293764-f92e-4de9-8f98-42b8eda62a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Flow 'volume_create_manager' (463ab79d-2466-4119-b660-f1e24f172865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:12 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-f6467bf4-14a2-4141-9553-deb78be9e249 tempest-GroupsV314Test-1171390860 None] Created volume successfully. Apr 24 19:17:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:13 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Cloning volume a90bf0ae-06a3-4e92-8be3-01644e36798d to volume b8def9fb-be19-4057-a44e-dbf6b2989e77 Apr 24 19:17:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Creating offline snapshot 43d4dd43-d950-4a65-ada2-f07643b5b34e of volume a90bf0ae-06a3-4e92-8be3-01644e36798d {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:17:13 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c825ecf3-6987-4691-a4f3-d29bcd9b8d13]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:14 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d Apr 24 19:17:14 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:15 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d" returned: 0 in 1.215s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:15 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e 1G Apr 24 19:17:15 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:16 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e 1G" returned: 0 in 1.135s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a90bf0ae-06a3-4e92-8be3-01644e36798d -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:16 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a90bf0ae-06a3-4e92-8be3-01644e36798d -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e Apr 24 19:17:16 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:17 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a90bf0ae-06a3-4e92-8be3-01644e36798d -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e" returned: 0 in 1.002s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:17 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:17:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:17 devstack sudo[87305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e Apr 24 19:17:17 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:17 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e" returned: 0 in 0.684s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:17 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.info Apr 24 19:17:17 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:18 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.info" returned: 0 in 0.679s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:18 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:17:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:18 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.info Apr 24 19:17:18 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:19 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.info" returned: 0 in 0.985s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Acquiring lock "cinder-quobyte-b8def9fb-be19-4057-a44e-dbf6b2989e77" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Lock "cinder-quobyte-b8def9fb-be19-4057-a44e-dbf6b2989e77" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] snapshot: 43d4dd43-d950-4a65-ada2-f07643b5b34e, volume: b8def9fb-be19-4057-a44e-dbf6b2989e77, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:17:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:19 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa3127a-1101-46ad-a923-772a2647b47d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:19 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e Apr 24 19:17:19 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:20 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e" returned: 0 in 0.789s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a90bf0ae-06a3-4e92-8be3-01644e36798d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:17:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:17:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:17:20 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4088e5-47c2-4a28-a867-f235d57a02d4]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:20 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d Apr 24 19:17:20 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:21 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d" returned: 0 in 0.800s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:21 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77 not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:17:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:21 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77 Apr 24 19:17:21 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:21 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5b115f6c-0b40-4f7c-844b-60c79b90ec68 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Terminate volume connection completed successfully. Apr 24 19:17:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5b115f6c-0b40-4f7c-844b-60c79b90ec68 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Deleting attachment 3a49f298-971d-4ca0-b627-cd310fa937cd. {{(pid=82057) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 19:17:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "cinder-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "cinder-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "cinder-quobyte-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "cinder-quobyte-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179" acquired by "delete_volume" :: waited 0.054s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:22 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8d01c6-1e78-4e9a-83ce-1cd88d4a50df]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:22 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 Apr 24 19:17:22 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:24 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179" returned: 0 in 1.649s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:24 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179 Apr 24 19:17:24 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:25 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179" returned: 0 in 1.274s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "cinder-quobyte-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179" released by "delete_volume" :: held 3.095s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:25 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:UPDATE=151,cinder:SELECT=109,cinder:DELETE=10,cinder:INSERT=29 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:17:25 devstack cinder-volume[82057]: DEBUG cinder.quota [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Created reservations ['77b27f9e-c392-473b-be79-d83471c0eef9', '11a3e0f9-af11-416f-bc3d-b2821e636c41', '5e5d01cc-8014-4e98-8f5e-a056bb84a15b', 'fb7a57a3-5c14-44d0-979f-8495a24cf4b3'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:26 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:17:26 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:28 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 2.331s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:28 devstack cinder-volume[82057]: DEBUG cinder.manager [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Deleted volume successfully. Apr 24 19:17:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-e574a431-a589-4f9d-ab91-8045289185b2 req-5ccefe6f-a3ee-462f-a2d9-8518fa173ef0 tempest-ServerBootFromVolumeStableRescueTest-240815626 None] Lock "cinder-5f2e1aca-0cf5-4ab5-8c35-f1362cbb1179-delete_volume" released by "delete_volume" :: held 6.301s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:32 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77" returned: 0 in 10.922s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:32 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda43008-5f33-4f2d-9993-e4153cc05bc2]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:32 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d Apr 24 19:17:32 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:33 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d" returned: 0 in 1.480s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:33 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d, size 1024.00 MB, duration 10.92 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77 {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:17:33 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Converted 1024.00 MB image at 93.74 MB/s Apr 24 19:17:33 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 19:17:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:33 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77 Apr 24 19:17:33 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:34 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77" returned: 0 in 0.707s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Lock "cinder-quobyte-b8def9fb-be19-4057-a44e-dbf6b2989e77" released by "_copy_volume_from_snapshot" :: held 14.823s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Acquiring lock "cinder-quobyte-43d4dd43-d950-4a65-ada2-f07643b5b34e" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Lock "cinder-quobyte-43d4dd43-d950-4a65-ada2-f07643b5b34e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Deleting offline snapshot 43d4dd43-d950-4a65-ada2-f07643b5b34e of volume a90bf0ae-06a3-4e92-8be3-01644e36798d {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:17:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] snapshot_file for this snap is: volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:17:34 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[3298ff05-2580-4b17-ba24-fabe66e209ab]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:34 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e Apr 24 19:17:34 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:35 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e" returned: 0 in 0.975s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:35 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a90bf0ae-06a3-4e92-8be3-01644e36798d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:17:35 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c985dce-151b-4bce-98c3-84bd6167e706]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:35 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d Apr 24 19:17:35 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:36 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d" returned: 0 in 0.950s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:36 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e Apr 24 19:17:36 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:37 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e" returned: 0 in 0.801s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:37 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e Apr 24 19:17:37 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:38 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d.43d4dd43-d950-4a65-ada2-f07643b5b34e" returned: 0 in 0.856s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Lock "cinder-quobyte-43d4dd43-d950-4a65-ada2-f07643b5b34e" released by "_delete_snapshot" :: held 3.706s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.532s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:38 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-34eadac7-7a07-495e-abea-30da1e4f7825 tempest-GroupsV314Test-1171390860 None] Create group from source-group-2fff0ea3-7a01-47d7-94ec-6fe6c025b443 completed successfully. Apr 24 19:17:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Acquiring lock "cinder-quobyte-b8def9fb-be19-4057-a44e-dbf6b2989e77" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Lock "cinder-quobyte-b8def9fb-be19-4057-a44e-dbf6b2989e77" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:39 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00821e2-993c-4b34-9c6f-fe976e77cf04]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:39 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77 Apr 24 19:17:39 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:40 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77" returned: 0 in 0.773s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:40 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77 Apr 24 19:17:40 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:40 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b8def9fb-be19-4057-a44e-dbf6b2989e77" returned: 0 in 0.716s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Lock "cinder-quobyte-b8def9fb-be19-4057-a44e-dbf6b2989e77" released by "delete_volume" :: held 1.540s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:41 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Created reservations ['159264c9-ea5c-4690-a765-462ec15bbb10'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:41 devstack cinder-volume[82057]: WARNING cinder.quota [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1930099490 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1930099490, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:17:41 devstack cinder-volume[82057]: WARNING cinder.quota [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1930099490 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1930099490, it is now deprecated. Please use the default quota class for default quota. Apr 24 19:17:41 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Created reservations ['01f22f28-4f09-4b85-9101-02761f285aff', '11504fa6-0ebe-435e-b32a-8f3224a1386f', '2ef6ff2a-2e8b-4e0b-a419-aa616e1feb2a', 'c92521fd-b153-4909-ba62-97add36c14cb'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:41 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:17:41 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:42 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Acquiring lock "cinder-quobyte-a90bf0ae-06a3-4e92-8be3-01644e36798d" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:42 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Lock "cinder-quobyte-a90bf0ae-06a3-4e92-8be3-01644e36798d" acquired by "delete_volume" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:42 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c09d7b-7953-42f1-beec-878301f552c7]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:42 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d Apr 24 19:17:42 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:42 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.009s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:42 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:42 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-fadafa0e-8eaf-4c2b-a4d7-0a4cfc8768fc tempest-GroupsV314Test-1171390860 None] Delete group completed successfully. Apr 24 19:17:42 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d" returned: 0 in 0.711s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:43 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d Apr 24 19:17:43 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:43 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a90bf0ae-06a3-4e92-8be3-01644e36798d" returned: 0 in 0.800s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Lock "cinder-quobyte-a90bf0ae-06a3-4e92-8be3-01644e36798d" released by "delete_volume" :: held 1.602s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:43 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Created reservations ['802f1dd8-9661-46e9-b4af-285eb320551c'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:43 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Created reservations ['c84d4dec-055b-45fe-a156-f4fde88a02c9', '9daccce3-c154-4253-8efd-d0bafb4c0bac', 'fc66bcfc-4708-4d63-ae35-09cbbeb9c72b', '787b3cf4-6d10-4258-9cee-d0b61751f655'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:44 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:17:44 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:45 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.164s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:45 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:45 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-62aa85ce-c1a2-430e-93d3-a1641dc5b675 tempest-GroupsV314Test-1171390860 None] Delete group completed successfully. Apr 24 19:17:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Acquiring lock "cinder-69669509-357c-4df2-9755-1de05bdfba57-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Lock "cinder-69669509-357c-4df2-9755-1de05bdfba57-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Acquiring lock "cinder-quobyte-69669509-357c-4df2-9755-1de05bdfba57" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Lock "cinder-quobyte-69669509-357c-4df2-9755-1de05bdfba57" acquired by "delete_volume" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:52 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb9822a-4ab2-40cb-9ea4-92210633680d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:52 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57 Apr 24 19:17:52 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:53 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57" returned: 0 in 1.030s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:53 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57 Apr 24 19:17:53 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Flow 'volume_create_manager' (0934b1cf-2649-4842-b504-04f12c804af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2eda41-6354-4588-ab21-645cabb57755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2eda41-6354-4588-ab21-645cabb57755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1511958896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22e79b5-26e7-44a8-bd76-367d60d9886c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8fea9e8f6a247f8b7c229589274b971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:53Z,use_quota=True,user_id='1469c942e5fa44f4be278ebcac71840d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ef05c8-2c89-4d12-a272-9bee2c07b90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ef05c8-2c89-4d12-a272-9bee2c07b90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d13761-e37b-4ee8-ac91-f94b232f82d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d13761-e37b-4ee8-ac91-f94b232f82d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c22e79b5-26e7-44a8-bd76-367d60d9886c', 'volume_name': 'volume-c22e79b5-26e7-44a8-bd76-367d60d9886c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9089791f-82bf-4a05-81d7-2bc59da47dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9089791f-82bf-4a05-81d7-2bc59da47dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8b2838-82a9-4957-9cdf-fbb511975cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:53 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Volume c22e79b5-26e7-44a8-bd76-367d60d9886c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c22e79b5-26e7-44a8-bd76-367d60d9886c', 'volume_size': 1} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1511958896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22e79b5-26e7-44a8-bd76-367d60d9886c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d8fea9e8f6a247f8b7c229589274b971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:53Z,use_quota=True,user_id='1469c942e5fa44f4be278ebcac71840d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Creating volume c22e79b5-26e7-44a8-bd76-367d60d9886c {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:53 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:17:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:53 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c 1073741824 Apr 24 19:17:53 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:54 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-69669509-357c-4df2-9755-1de05bdfba57" returned: 0 in 1.138s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Lock "cinder-quobyte-69669509-357c-4df2-9755-1de05bdfba57" released by "delete_volume" :: held 2.253s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:54 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Created reservations ['4e7434c6-8f98-4aeb-9aa3-edf7b681d155', '870d1abb-97b6-4645-b4f1-5232494aea37', 'f75f40a2-8e0f-45ac-892a-3bf57267d778', '7f44281f-d108-481f-a875-58d607a37963'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:54 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:17:54 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:54 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c 1073741824" returned: 0 in 1.221s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:54 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c Apr 24 19:17:54 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:55 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c" returned: 0 in 0.684s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:17:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8b2838-82a9-4957-9cdf-fbb511975cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22e79b5-26e7-44a8-bd76-367d60d9886c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7381ea23-c60d-4cdc-a5ad-7ecac3f663f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:55 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Volume volume-c22e79b5-26e7-44a8-bd76-367d60d9886c (c22e79b5-26e7-44a8-bd76-367d60d9886c): created successfully Apr 24 19:17:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7381ea23-c60d-4cdc-a5ad-7ecac3f663f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Flow 'volume_create_manager' (0934b1cf-2649-4842-b504-04f12c804af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:55 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-6e72baee-cd31-498f-94fb-1921d569acfe req-f3eace93-24e8-4617-9de7-80c20d0385a2 tempest-VolumesGetTestJSON-1523837630 None] Created volume successfully. Apr 24 19:17:55 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.076s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:55 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:55 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Deleted volume successfully. Apr 24 19:17:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-10fc7a17-7ccc-42e5-8141-a67d6b97ddca tempest-VolumesNegativeTest-30219490 None] Lock "cinder-69669509-357c-4df2-9755-1de05bdfba57-delete_volume" released by "delete_volume" :: held 3.774s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Acquiring lock "cinder-c22e79b5-26e7-44a8-bd76-367d60d9886c-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Lock "cinder-c22e79b5-26e7-44a8-bd76-367d60d9886c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:56 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=71,cinder:UPDATE=88,cinder:INSERT=21,cinder:DELETE=3 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:17:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Acquiring lock "cinder-quobyte-c22e79b5-26e7-44a8-bd76-367d60d9886c" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:17:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Lock "cinder-quobyte-c22e79b5-26e7-44a8-bd76-367d60d9886c" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:17:56 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaaa2d2-17eb-4409-9a46-ba7f62505a95]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:17:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:57 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c Apr 24 19:17:57 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:57 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c" returned: 0 in 0.795s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:57 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c Apr 24 19:17:57 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:57 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-87e9ec7f-fec3-483c-ade6-4964d85e33b3 tempest-GroupsV320Test-1740670223 None] Group tempest-GroupsV320Test-Group-305211843: creating Apr 24 19:17:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-87e9ec7f-fec3-483c-ade6-4964d85e33b3 tempest-GroupsV320Test-1740670223 None] Group tempest-GroupsV320Test-Group-305211843: created successfully Apr 24 19:17:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-87e9ec7f-fec3-483c-ade6-4964d85e33b3 tempest-GroupsV320Test-1740670223 None] Create group completed successfully. Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:58 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:17:58 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:58 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c22e79b5-26e7-44a8-bd76-367d60d9886c" returned: 0 in 0.696s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Lock "cinder-quobyte-c22e79b5-26e7-44a8-bd76-367d60d9886c" released by "delete_volume" :: held 1.573s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG cinder.quota [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Created reservations ['197ff3c6-d058-4964-a7ee-2e42bd3ce468', '21222d88-beaf-468b-86fd-869df6516529', 'dea6be5e-105b-43c8-b564-aff4a81136e4', 'e11126c5-901b-49b9-bde2-e03fce4d0551'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:58 devstack sudo[87620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:17:58 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Flow 'volume_create_manager' (a86fbb82-e5bd-46e3-a8f3-ba6cd1283141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f64f74-30a1-4cfd-9995-dfc3fa9688cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:58 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f64f74-30a1-4cfd-9995-dfc3fa9688cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868526983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef37c64a-9c23-45f0-8693-533ec7e5babe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ed5d8913c4e4891bab09c470db7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:59Z,use_quota=True,user_id='a0dd63f345d844cbb34bfbd71f988485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d321251d-fa28-41b2-8711-e0fd15feb626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d321251d-fa28-41b2-8711-e0fd15feb626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8857fce5-e96b-402b-b0ae-6b39ce9dc1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8857fce5-e96b-402b-b0ae-6b39ce9dc1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef37c64a-9c23-45f0-8693-533ec7e5babe', 'volume_name': 'volume-ef37c64a-9c23-45f0-8693-533ec7e5babe', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686c8c49-be65-4003-8589-206c65544e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686c8c49-be65-4003-8589-206c65544e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f356ab-8b43-4c86-88a9-f1ed00a38ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:59 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Volume ef37c64a-9c23-45f0-8693-533ec7e5babe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef37c64a-9c23-45f0-8693-533ec7e5babe', 'volume_size': 1} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-868526983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef37c64a-9c23-45f0-8693-533ec7e5babe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ed5d8913c4e4891bab09c470db7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:59Z,use_quota=True,user_id='a0dd63f345d844cbb34bfbd71f988485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Creating volume ef37c64a-9c23-45f0-8693-533ec7e5babe {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:17:59 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.742s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:59 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe 1073741824 Apr 24 19:17:59 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Flow 'volume_create_manager' (072d15e4-f200-4130-b065-e586b3785dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243160f6-146e-4957-a48e-e77b913479bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243160f6-146e-4957-a48e-e77b913479bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-22318290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57013a76-8207-4e01-9f6d-c3cddaa82645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ed5d8913c4e4891bab09c470db7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:59Z,use_quota=True,user_id='a0dd63f345d844cbb34bfbd71f988485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201db314-d559-40b4-aefd-f0b1193d3fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201db314-d559-40b4-aefd-f0b1193d3fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41bdda1-602a-4ee0-b700-f6af8b0d90a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41bdda1-602a-4ee0-b700-f6af8b0d90a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57013a76-8207-4e01-9f6d-c3cddaa82645', 'volume_name': 'volume-57013a76-8207-4e01-9f6d-c3cddaa82645', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8c492d-dcb5-4801-9155-2e32e963b814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8c492d-dcb5-4801-9155-2e32e963b814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf21db3-6e9b-4301-8e23-2d3ba43b6f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:17:59 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Volume 57013a76-8207-4e01-9f6d-c3cddaa82645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57013a76-8207-4e01-9f6d-c3cddaa82645', 'volume_size': 1} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:17:59 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.146s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.manager [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:17:59 devstack cinder-volume[82057]: INFO cinder.volume.manager [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Deleted volume successfully. Apr 24 19:17:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [req-0d8dce0c-4b3a-4e7a-ba18-c1f1792b5d7e req-8912cd90-b28d-40ec-accb-c085e98e047d tempest-VolumesGetTestJSON-1523837630 None] Lock "cinder-c22e79b5-26e7-44a8-bd76-367d60d9886c-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-aa28706e-adb9-462a-81b9-ae65e39814df tempest-GroupsV320Test-1740670223 None] Created reservations ['07991fe6-d6f0-4e7d-b474-516451ff3a6f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aa28706e-adb9-462a-81b9-ae65e39814df tempest-GroupsV320Test-1740670223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aa28706e-adb9-462a-81b9-ae65e39814df tempest-GroupsV320Test-1740670223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aa28706e-adb9-462a-81b9-ae65e39814df tempest-GroupsV320Test-1740670223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aa28706e-adb9-462a-81b9-ae65e39814df tempest-GroupsV320Test-1740670223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aa28706e-adb9-462a-81b9-ae65e39814df tempest-GroupsV320Test-1740670223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aa28706e-adb9-462a-81b9-ae65e39814df tempest-GroupsV320Test-1740670223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:00 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:00 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Flow 'volume_create_manager' (d7e2eb5e-e8d1-4384-839a-8e5e6cdaf845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79559397-dd7d-4a25-b421-24c788b6fbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79559397-dd7d-4a25-b421-24c788b6fbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-62637536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b630c89b-c50a-4609-9f95-70ff4cc91050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ed5d8913c4e4891bab09c470db7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:00Z,use_quota=True,user_id='a0dd63f345d844cbb34bfbd71f988485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a811da3-698a-4a13-9983-547cbbc60868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a811da3-698a-4a13-9983-547cbbc60868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493687a7-6106-4cd0-8123-bcfc99339a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493687a7-6106-4cd0-8123-bcfc99339a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b630c89b-c50a-4609-9f95-70ff4cc91050', 'volume_name': 'volume-b630c89b-c50a-4609-9f95-70ff4cc91050', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035cc1da-4f23-4e03-946c-404f3a26c97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035cc1da-4f23-4e03-946c-404f3a26c97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06085b6-83ce-4917-94aa-a2d4eb3ded11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:00 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Volume b630c89b-c50a-4609-9f95-70ff4cc91050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b630c89b-c50a-4609-9f95-70ff4cc91050', 'volume_size': 1} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:00 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe 1073741824" returned: 0 in 1.555s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:00 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe Apr 24 19:18:00 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Flow 'volume_create_manager' (697c12be-7dfb-401c-9998-b05fa93b4fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8038807a-958e-4598-9d99-7cfb4a9bf881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8038807a-958e-4598-9d99-7cfb4a9bf881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716920615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4680854f-9ef3-4986-9f0d-4c049a967cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ed5d8913c4e4891bab09c470db7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:01Z,use_quota=True,user_id='a0dd63f345d844cbb34bfbd71f988485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bc15a3-bcca-4b13-a6ad-247ad9f72a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bc15a3-bcca-4b13-a6ad-247ad9f72a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4401c6-edf5-490f-958c-8c625b4b242a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4401c6-edf5-490f-958c-8c625b4b242a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4680854f-9ef3-4986-9f0d-4c049a967cef', 'volume_name': 'volume-4680854f-9ef3-4986-9f0d-4c049a967cef', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1942b7-7297-4003-bf4b-431d4c773d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1942b7-7297-4003-bf4b-431d4c773d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92c415b-2330-4a32-872c-212f877f995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Volume 4680854f-9ef3-4986-9f0d-4c049a967cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4680854f-9ef3-4986-9f0d-4c049a967cef', 'volume_size': 1} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:01 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aa28706e-adb9-462a-81b9-ae65e39814df tempest-GroupsV320Test-1740670223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.315s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-aa28706e-adb9-462a-81b9-ae65e39814df tempest-GroupsV320Test-1740670223 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-aa28706e-adb9-462a-81b9-ae65e39814df tempest-GroupsV320Test-1740670223 None] Delete group completed successfully. Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Flow 'volume_create_manager' (e5fcdca4-32d4-4023-9b8a-67fe1ce708ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5755c5-022b-4427-bb8d-09befee8eea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5755c5-022b-4427-bb8d-09befee8eea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1244331076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0868b6b9-3a47-4022-8221-01f27bc50bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ed5d8913c4e4891bab09c470db7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:02Z,use_quota=True,user_id='a0dd63f345d844cbb34bfbd71f988485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d98eb23-4726-4b18-8750-29078a049bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d98eb23-4726-4b18-8750-29078a049bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc7fc70-acc4-4bd1-8842-f71c0ca71b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc7fc70-acc4-4bd1-8842-f71c0ca71b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0868b6b9-3a47-4022-8221-01f27bc50bcd', 'volume_name': 'volume-0868b6b9-3a47-4022-8221-01f27bc50bcd', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6f191a-9a85-4b0b-9d32-721ca68cd0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6f191a-9a85-4b0b-9d32-721ca68cd0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6024ff77-5287-464f-a026-7e97b5204760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:02 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Volume 0868b6b9-3a47-4022-8221-01f27bc50bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0868b6b9-3a47-4022-8221-01f27bc50bcd', 'volume_size': 1} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:02 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe" returned: 0 in 1.408s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] <== create_volume: return (3022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.025s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.511s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-22318290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57013a76-8207-4e01-9f6d-c3cddaa82645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ed5d8913c4e4891bab09c470db7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:17:59Z,use_quota=True,user_id='a0dd63f345d844cbb34bfbd71f988485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Creating volume 57013a76-8207-4e01-9f6d-c3cddaa82645 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:02 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f356ab-8b43-4c86-88a9-f1ed00a38ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef37c64a-9c23-45f0-8693-533ec7e5babe', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d709699f-8e0c-4c5b-8d00-fa4a1489123b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:02 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645 1073741824 Apr 24 19:18:02 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:02 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Volume volume-ef37c64a-9c23-45f0-8693-533ec7e5babe (ef37c64a-9c23-45f0-8693-533ec7e5babe): created successfully Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d709699f-8e0c-4c5b-8d00-fa4a1489123b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Flow 'volume_create_manager' (a86fbb82-e5bd-46e3-a8f3-ba6cd1283141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:02 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1f6f7236-0722-4dc9-8a83-34d09ed2c3f9 tempest-CreateVolumesFromImageTest-1217481114 None] Created volume successfully. Apr 24 19:18:03 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645 1073741824" returned: 0 in 1.273s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:03 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645 Apr 24 19:18:03 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:04 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645" returned: 0 in 0.815s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.751s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-62637536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b630c89b-c50a-4609-9f95-70ff4cc91050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ed5d8913c4e4891bab09c470db7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:00Z,use_quota=True,user_id='a0dd63f345d844cbb34bfbd71f988485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Creating volume b630c89b-c50a-4609-9f95-70ff4cc91050 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:04 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:04 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050 1073741824 Apr 24 19:18:04 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf21db3-6e9b-4301-8e23-2d3ba43b6f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57013a76-8207-4e01-9f6d-c3cddaa82645', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf85039-911c-4b34-a2f3-074d1a3c2f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:04 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Volume volume-57013a76-8207-4e01-9f6d-c3cddaa82645 (57013a76-8207-4e01-9f6d-c3cddaa82645): created successfully Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf85039-911c-4b34-a2f3-074d1a3c2f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Flow 'volume_create_manager' (072d15e4-f200-4130-b065-e586b3785dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:04 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3aab3313-dec8-40ef-916b-5b1b0cb62902 tempest-CreateVolumesFromImageTest-1217481114 None] Created volume successfully. Apr 24 19:18:05 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050 1073741824" returned: 0 in 1.306s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:05 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050 Apr 24 19:18:05 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:06 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050" returned: 0 in 0.737s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.316s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.438s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716920615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4680854f-9ef3-4986-9f0d-4c049a967cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ed5d8913c4e4891bab09c470db7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:01Z,use_quota=True,user_id='a0dd63f345d844cbb34bfbd71f988485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Creating volume 4680854f-9ef3-4986-9f0d-4c049a967cef {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:06 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06085b6-83ce-4917-94aa-a2d4eb3ded11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b630c89b-c50a-4609-9f95-70ff4cc91050', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:06 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef 1073741824 Apr 24 19:18:06 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5b6245-0f62-4898-900e-3aa7b88c4bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:06 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Volume volume-b630c89b-c50a-4609-9f95-70ff4cc91050 (b630c89b-c50a-4609-9f95-70ff4cc91050): created successfully Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5b6245-0f62-4898-900e-3aa7b88c4bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Flow 'volume_create_manager' (d7e2eb5e-e8d1-4384-839a-8e5e6cdaf845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:06 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-fe895143-002d-457f-8471-35f1f134dd9b tempest-CreateVolumesFromImageTest-1217481114 None] Created volume successfully. Apr 24 19:18:07 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef 1073741824" returned: 0 in 0.993s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:07 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef Apr 24 19:18:07 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:08 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef" returned: 0 in 0.661s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.291s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1244331076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0868b6b9-3a47-4022-8221-01f27bc50bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3ed5d8913c4e4891bab09c470db7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:02Z,use_quota=True,user_id='a0dd63f345d844cbb34bfbd71f988485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Creating volume 0868b6b9-3a47-4022-8221-01f27bc50bcd {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:08 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92c415b-2330-4a32-872c-212f877f995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4680854f-9ef3-4986-9f0d-4c049a967cef', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87181028-aba4-431f-936b-c1ccb0b84ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:08 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd 1073741824 Apr 24 19:18:08 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:08 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Volume volume-4680854f-9ef3-4986-9f0d-4c049a967cef (4680854f-9ef3-4986-9f0d-4c049a967cef): created successfully Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87181028-aba4-431f-936b-c1ccb0b84ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Flow 'volume_create_manager' (697c12be-7dfb-401c-9998-b05fa93b4fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:08 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-33a571c2-0845-4ba5-a517-ed4740e0af7a tempest-CreateVolumesFromImageTest-1217481114 None] Created volume successfully. Apr 24 19:18:09 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd 1073741824" returned: 0 in 0.997s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:09 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd Apr 24 19:18:09 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:09 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd" returned: 0 in 0.636s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6024ff77-5287-464f-a026-7e97b5204760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0868b6b9-3a47-4022-8221-01f27bc50bcd', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5ddac7-16e0-476a-a998-da6e4d6a65b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:10 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Volume volume-0868b6b9-3a47-4022-8221-01f27bc50bcd (0868b6b9-3a47-4022-8221-01f27bc50bcd): created successfully Apr 24 19:18:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5ddac7-16e0-476a-a998-da6e4d6a65b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Flow 'volume_create_manager' (e5fcdca4-32d4-4023-9b8a-67fe1ce708ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:10 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1f76e7df-5cba-40e5-b4dd-8f404a858116 tempest-CreateVolumesFromImageTest-1217481114 None] Created volume successfully. Apr 24 19:18:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "cinder-0868b6b9-3a47-4022-8221-01f27bc50bcd-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-0868b6b9-3a47-4022-8221-01f27bc50bcd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "cinder-quobyte-0868b6b9-3a47-4022-8221-01f27bc50bcd" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-quobyte-0868b6b9-3a47-4022-8221-01f27bc50bcd" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:11 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6788c0e-89f3-41fb-b751-050812cd441a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:11 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd Apr 24 19:18:11 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:12 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd" returned: 0 in 0.936s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:12 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd Apr 24 19:18:12 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:13 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0868b6b9-3a47-4022-8221-01f27bc50bcd" returned: 0 in 0.859s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-quobyte-0868b6b9-3a47-4022-8221-01f27bc50bcd" released by "delete_volume" :: held 1.893s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Created reservations ['0597a62e-77e2-4314-8878-e164346cedbc', '444184d7-bb01-458c-b02d-1248c6b50229', '3a33e841-e92c-40fc-9473-872dabd8590f', 'd1efaa5d-2383-4623-9603-f8a24e14a0c1'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "cinder-4680854f-9ef3-4986-9f0d-4c049a967cef-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:13 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:13 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-4680854f-9ef3-4986-9f0d-4c049a967cef-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "cinder-quobyte-4680854f-9ef3-4986-9f0d-4c049a967cef" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-quobyte-4680854f-9ef3-4986-9f0d-4c049a967cef" acquired by "delete_volume" :: waited 0.045s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb10d267-59f3-43e0-913a-4ed2fff9a485]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:14 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef Apr 24 19:18:14 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:14 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.934s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:14 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:14 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Deleted volume successfully. Apr 24 19:18:14 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-435da6e8-5239-4c7b-b209-24ffddd090be tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-0868b6b9-3a47-4022-8221-01f27bc50bcd-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:15 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef" returned: 0 in 1.287s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:15 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef Apr 24 19:18:15 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:16 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4680854f-9ef3-4986-9f0d-4c049a967cef" returned: 0 in 0.972s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-quobyte-4680854f-9ef3-4986-9f0d-4c049a967cef" released by "delete_volume" :: held 2.437s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Created reservations ['b91fc55b-deb8-4667-8120-4e62d891fdbb', '762507cf-8a3e-4915-8ce6-820f0b5ef308', '8bab8740-1980-4b67-8b2f-a08a402b75e8', 'ff046f60-6f15-424d-8deb-965dd3b80132'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (0372840e-b0b0-4386-9283-e39f7b7e71b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00dce5e5-a7f3-43a8-8205-9d189d3a4e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00dce5e5-a7f3-43a8-8205-9d189d3a4e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-826675373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61090fd-5dab-4844-b406-e167c55b3766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:16Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c52cc8-82a2-4636-831a-98c088cc4a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c52cc8-82a2-4636-831a-98c088cc4a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6139f586-db59-48d1-a7d7-01c5998db4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6139f586-db59-48d1-a7d7-01c5998db4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61090fd-5dab-4844-b406-e167c55b3766', 'volume_name': 'volume-f61090fd-5dab-4844-b406-e167c55b3766', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfec53cf-86ca-4aba-9298-9be0fb8681a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfec53cf-86ca-4aba-9298-9be0fb8681a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17376cc-fce9-419b-9bd1-866bbc157491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:16 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Volume f61090fd-5dab-4844-b406-e167c55b3766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61090fd-5dab-4844-b406-e167c55b3766', 'volume_size': 1} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-826675373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61090fd-5dab-4844-b406-e167c55b3766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:16Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Creating volume f61090fd-5dab-4844-b406-e167c55b3766 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:16 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:16 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766 1073741824 Apr 24 19:18:16 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:16 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:16 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "cinder-b630c89b-c50a-4609-9f95-70ff4cc91050-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-b630c89b-c50a-4609-9f95-70ff4cc91050-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "cinder-quobyte-b630c89b-c50a-4609-9f95-70ff4cc91050" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-quobyte-b630c89b-c50a-4609-9f95-70ff4cc91050" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:17 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d246c2-b051-4a27-9eb3-7b59f2352e60]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:17 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050 Apr 24 19:18:17 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:17 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.210s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:17 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:17 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Deleted volume successfully. Apr 24 19:18:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9e4c92d6-3ac7-4ce9-b5f2-1bd64c47488f tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-4680854f-9ef3-4986-9f0d-4c049a967cef-delete_volume" released by "delete_volume" :: held 4.320s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:18 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766 1073741824" returned: 0 in 1.743s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:18 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050" returned: 0 in 1.098s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:18 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766 Apr 24 19:18:18 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:18 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050 Apr 24 19:18:18 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:19 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766" returned: 0 in 0.757s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] <== create_volume: return (2619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.623s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17376cc-fce9-419b-9bd1-866bbc157491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61090fd-5dab-4844-b406-e167c55b3766', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bb3672-022f-48cd-b2b2-1a437bef0fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:19 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Volume volume-f61090fd-5dab-4844-b406-e167c55b3766 (f61090fd-5dab-4844-b406-e167c55b3766): created successfully Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bb3672-022f-48cd-b2b2-1a437bef0fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (0372840e-b0b0-4386-9283-e39f7b7e71b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:19 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c2f9e027-c771-4f6e-881c-bfe35f28d0e7 tempest-VolumesActionsTest-846024063 None] Created volume successfully. Apr 24 19:18:19 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b630c89b-c50a-4609-9f95-70ff4cc91050" returned: 0 in 1.125s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-quobyte-b630c89b-c50a-4609-9f95-70ff4cc91050" released by "delete_volume" :: held 2.307s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Created reservations ['5e22063a-dd4a-4885-8e43-11a0449b510e', '3049b82e-70a1-4afb-b054-2e0df62b1886', '82fdf265-99b0-41a1-8a8f-7a0f9637db8f', '1a808eec-9485-4dd7-9107-638270fbcce8'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bdd123a-0e2d-45a2-b2ea-208a9cf19af2 tempest-VolumesActionsTest-846024063 None] Acquiring lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766" by "attach_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:20 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:20 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bdd123a-0e2d-45a2-b2ea-208a9cf19af2 tempest-VolumesActionsTest-846024063 None] Lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766" acquired by "attach_volume" :: waited 0.056s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:20 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-8bdd123a-0e2d-45a2-b2ea-208a9cf19af2 tempest-VolumesActionsTest-846024063 None] Attaching volume f61090fd-5dab-4844-b406-e167c55b3766 to instance 52d43c5b-8d0c-4700-a478-d010da2900c8 at mountpoint /dev/vdb on host None. Apr 24 19:18:20 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-8bdd123a-0e2d-45a2-b2ea-208a9cf19af2 tempest-VolumesActionsTest-846024063 None] Attach volume completed successfully. Apr 24 19:18:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bdd123a-0e2d-45a2-b2ea-208a9cf19af2 tempest-VolumesActionsTest-846024063 None] Lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766" released by "attach_volume" :: held 0.199s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "cinder-57013a76-8207-4e01-9f6d-c3cddaa82645-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-57013a76-8207-4e01-9f6d-c3cddaa82645-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "cinder-quobyte-57013a76-8207-4e01-9f6d-c3cddaa82645" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-quobyte-57013a76-8207-4e01-9f6d-c3cddaa82645" acquired by "delete_volume" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:20 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[678b7d17-7d46-4420-b365-3aeedccfd160]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:21 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.164s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:21 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:21 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Deleted volume successfully. Apr 24 19:18:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8915ea1b-cd28-486f-a864-fbeb67630611 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-b630c89b-c50a-4609-9f95-70ff4cc91050-delete_volume" released by "delete_volume" :: held 3.995s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:21 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645 Apr 24 19:18:21 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:21 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c446811c-5583-426c-bff5-a1d425515dc9 tempest-VolumesActionsTest-404350273 None] Terminate volume connection completed successfully. Apr 24 19:18:22 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645" returned: 0 in 1.331s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:22 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645 Apr 24 19:18:22 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c446811c-5583-426c-bff5-a1d425515dc9 tempest-VolumesActionsTest-404350273 None] Acquiring lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766-detach_volume" by "detach_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c446811c-5583-426c-bff5-a1d425515dc9 tempest-VolumesActionsTest-404350273 None] Lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:22 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c446811c-5583-426c-bff5-a1d425515dc9 tempest-VolumesActionsTest-404350273 None] Detaching volume f61090fd-5dab-4844-b406-e167c55b3766 from instance 52d43c5b-8d0c-4700-a478-d010da2900c8. Apr 24 19:18:22 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c446811c-5583-426c-bff5-a1d425515dc9 tempest-VolumesActionsTest-404350273 None] Detach volume completed successfully. Apr 24 19:18:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c446811c-5583-426c-bff5-a1d425515dc9 tempest-VolumesActionsTest-404350273 None] Lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766-detach_volume" released by "detach_volume" :: held 0.166s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:23 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-57013a76-8207-4e01-9f6d-c3cddaa82645" returned: 0 in 0.852s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-quobyte-57013a76-8207-4e01-9f6d-c3cddaa82645" released by "delete_volume" :: held 2.263s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Created reservations ['1558a1f0-c51c-4ac8-9c9e-274475cbd45d', '2b87bde2-095d-4860-96b1-87b7270276fe', '7de85852-1371-4514-a959-28d159a1838f', 'c861b4ae-da9e-40aa-ac78-46c3fd8711d7'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e372c7a0-39b6-491c-9c97-25d9ac65548f tempest-VolumesActionsTest-846024063 None] Acquiring lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766-detach_volume" by "detach_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e372c7a0-39b6-491c-9c97-25d9ac65548f tempest-VolumesActionsTest-846024063 None] Lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766-detach_volume" acquired by "detach_volume" :: waited 0.121s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:23 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e372c7a0-39b6-491c-9c97-25d9ac65548f tempest-VolumesActionsTest-846024063 None] Volume detach called, but volume not attached. Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e372c7a0-39b6-491c-9c97-25d9ac65548f tempest-VolumesActionsTest-846024063 None] Lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:23 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:23 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "cinder-ef37c64a-9c23-45f0-8693-533ec7e5babe-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-ef37c64a-9c23-45f0-8693-533ec7e5babe-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "cinder-quobyte-ef37c64a-9c23-45f0-8693-533ec7e5babe" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-quobyte-ef37c64a-9c23-45f0-8693-533ec7e5babe" acquired by "delete_volume" :: waited 0.043s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab462d-eac9-4587-bb32-6cdbea68a8a5]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:24 devstack sudo[87822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe Apr 24 19:18:24 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Acquiring lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Acquiring lock "cinder-quobyte-f61090fd-5dab-4844-b406-e167c55b3766" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Lock "cinder-quobyte-f61090fd-5dab-4844-b406-e167c55b3766" acquired by "delete_volume" :: waited 0.044s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:24 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b1eeea-d650-4630-a985-0554c4296179]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:24 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766 Apr 24 19:18:24 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:24 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe" returned: 0 in 1.009s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:25 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe Apr 24 19:18:25 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:25 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.691s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:25 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:25 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Deleted volume successfully. Apr 24 19:18:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a5d082c2-469a-4127-bb00-212839a3d830 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-57013a76-8207-4e01-9f6d-c3cddaa82645-delete_volume" released by "delete_volume" :: held 4.383s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:25 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766" returned: 0 in 1.380s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:25 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766 Apr 24 19:18:25 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:26 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef37c64a-9c23-45f0-8693-533ec7e5babe" returned: 0 in 1.287s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-quobyte-ef37c64a-9c23-45f0-8693-533ec7e5babe" released by "delete_volume" :: held 2.389s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=91,cinder:INSERT=26,cinder:UPDATE=109,cinder:DELETE=9 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Created reservations ['6ae83596-6cfb-4a37-88c8-e9a4516825e4', '6c6fcff7-7d6c-43f5-9252-087306d8097f', '167af65d-02cd-431c-895a-1934e57e4d73', '170ab4c1-3ea4-42ac-9ede-ad46bbf25ed0'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:26 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:26 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:26 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f61090fd-5dab-4844-b406-e167c55b3766" returned: 0 in 0.922s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Lock "cinder-quobyte-f61090fd-5dab-4844-b406-e167c55b3766" released by "delete_volume" :: held 2.380s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:26 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Created reservations ['2543109e-602b-4093-b501-8327d2343d68', '5253329d-e9df-468d-a435-f252c79bfba7', 'a366e104-cae5-42b0-9d25-e5b5b821f996', '9dcbdbf1-d184-4afd-a0ab-468ba64b0d46'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:27 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:27 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:27 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.744s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:27 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Deleted volume successfully. Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9b1a820d-78b8-4095-9c68-3da0c2ef7920 tempest-CreateVolumesFromImageTest-1217481114 None] Lock "cinder-ef37c64a-9c23-45f0-8693-533ec7e5babe-delete_volume" released by "delete_volume" :: held 3.600s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:27 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.557s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:27 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Deleted volume successfully. Apr 24 19:18:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7f88b2c3-9c68-4c68-8178-9e862925b8eb tempest-VolumesActionsTest-846024063 None] Lock "cinder-f61090fd-5dab-4844-b406-e167c55b3766-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (fbb286a0-2efa-41e7-bbc3-d90204026b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856db362-2c5b-4065-915f-20eb372ae471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856db362-2c5b-4065-915f-20eb372ae471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319771120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fd354d-c0fa-4cb2-827d-063278c7c808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:33Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b3e61c-b056-4b89-bbec-3b2045530bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b3e61c-b056-4b89-bbec-3b2045530bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e610e9c-82f2-4a18-a939-551a33d07374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e610e9c-82f2-4a18-a939-551a33d07374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fd354d-c0fa-4cb2-827d-063278c7c808', 'volume_name': 'volume-79fd354d-c0fa-4cb2-827d-063278c7c808', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fce91de-e6ce-46f8-9bb0-440411423056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fce91de-e6ce-46f8-9bb0-440411423056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbcef860-e544-433e-b0a5-a2d4a0769ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:33 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume 79fd354d-c0fa-4cb2-827d-063278c7c808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fd354d-c0fa-4cb2-827d-063278c7c808', 'volume_size': 1} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319771120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fd354d-c0fa-4cb2-827d-063278c7c808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:33Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Creating volume 79fd354d-c0fa-4cb2-827d-063278c7c808 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:33 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:33 devstack sudo[87937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808 1073741824 Apr 24 19:18:33 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:34 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808 1073741824" returned: 0 in 1.121s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:34 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808 Apr 24 19:18:34 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:35 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808" returned: 0 in 0.757s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:35 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbcef860-e544-433e-b0a5-a2d4a0769ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fd354d-c0fa-4cb2-827d-063278c7c808', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d481615-6e48-445d-aa26-ebd49f2def6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:35 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume volume-79fd354d-c0fa-4cb2-827d-063278c7c808 (79fd354d-c0fa-4cb2-827d-063278c7c808): created successfully Apr 24 19:18:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d481615-6e48-445d-aa26-ebd49f2def6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (fbb286a0-2efa-41e7-bbc3-d90204026b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:35 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9f598eb7-5ed5-4911-a5d2-95f1fe93034c tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created volume successfully. Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (421e30e2-db84-416f-a4ba-646b074a030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ef55c8-07a8-4972-a4ec-0b1f2cf1b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ef55c8-07a8-4972-a4ec-0b1f2cf1b63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1322189000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f9f5d6-77e5-4a07-a291-064048366cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:37Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e753ef87-85d4-433f-a1a6-632616d9394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e753ef87-85d4-433f-a1a6-632616d9394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9c5f31-a766-4dac-b342-1e2b8ae57cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9c5f31-a766-4dac-b342-1e2b8ae57cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f9f5d6-77e5-4a07-a291-064048366cd6', 'volume_name': 'volume-89f9f5d6-77e5-4a07-a291-064048366cd6', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d49a52-b7c8-4dc6-a529-0dbf0dacaaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d49a52-b7c8-4dc6-a529-0dbf0dacaaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3db44fa-6caa-4e39-b5fa-580684c87688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:36 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Volume 89f9f5d6-77e5-4a07-a291-064048366cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f9f5d6-77e5-4a07-a291-064048366cd6', 'volume_size': 1} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1322189000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f9f5d6-77e5-4a07-a291-064048366cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:37Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Creating volume 89f9f5d6-77e5-4a07-a291-064048366cd6 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:36 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:36 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6 1073741824 Apr 24 19:18:36 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Flow 'volume_create_manager' (45e4bc8f-c3a1-49bb-8e0d-24dc583a5b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4c12e2-31c4-41f4-ad3f-42ac2b84df85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4c12e2-31c4-41f4-ad3f-42ac2b84df85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1227209888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba14997d-561a-46bb-89f8-01948caf1675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c51e6e98bd941819443fe6cc278de8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:37Z,use_quota=True,user_id='ffbc9be0096843369e7f5a4c615deac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9ac682-886e-4368-ab80-e87a2ffd06cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9ac682-886e-4368-ab80-e87a2ffd06cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf860ee9-7936-4a61-9aba-b1edaa3d09d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf860ee9-7936-4a61-9aba-b1edaa3d09d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba14997d-561a-46bb-89f8-01948caf1675', 'volume_name': 'volume-ba14997d-561a-46bb-89f8-01948caf1675', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69850bd5-f44c-4299-9174-4b4cf7798e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69850bd5-f44c-4299-9174-4b4cf7798e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae31b37-ddb6-4715-bbfa-4ee506fdc6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Volume ba14997d-561a-46bb-89f8-01948caf1675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba14997d-561a-46bb-89f8-01948caf1675', 'volume_size': 1} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (574be5de-f42f-43e6-9049-1867812d10b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad89cc3a-a158-49b1-9ea9-ebf35609afcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad89cc3a-a158-49b1-9ea9-ebf35609afcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1324100351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab81e4ee-cb2d-4f83-b42f-a586b06eef71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:37Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372e0429-32b4-4721-b903-0135b68b0b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372e0429-32b4-4721-b903-0135b68b0b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25c4481-209f-43cd-bcba-686af2ea9be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25c4481-209f-43cd-bcba-686af2ea9be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab81e4ee-cb2d-4f83-b42f-a586b06eef71', 'volume_name': 'volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1491877-d244-4103-a5b2-1632f8249e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1491877-d244-4103-a5b2-1632f8249e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ea67a0-c767-4b89-a13c-dbc87dd48c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume ab81e4ee-cb2d-4f83-b42f-a586b06eef71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71', 'volume_size': 1} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (14071248-ad9e-4190-b1a5-60f8af4cab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2e4054-308e-426f-8f54-b9c97eecdbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2e4054-308e-426f-8f54-b9c97eecdbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-458356333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec466bac-3806-41fd-9cd5-ee12f819c369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:38Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676bc676-b7be-4840-b7c1-02131d027fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676bc676-b7be-4840-b7c1-02131d027fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92d0775-12e2-45ab-9c78-e9e4b304887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92d0775-12e2-45ab-9c78-e9e4b304887e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec466bac-3806-41fd-9cd5-ee12f819c369', 'volume_name': 'volume-ec466bac-3806-41fd-9cd5-ee12f819c369', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbdbd87-1d0a-4424-87c8-c4d30bda86e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbdbd87-1d0a-4424-87c8-c4d30bda86e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d487d3ac-22a5-4f32-b808-9164d58efb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:37 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:37 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume ec466bac-3806-41fd-9cd5-ee12f819c369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec466bac-3806-41fd-9cd5-ee12f819c369', 'volume_size': 1} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6 1073741824" returned: 0 in 1.012s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:37 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6 Apr 24 19:18:37 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Flow 'volume_create_manager' (7b325d5a-ce3d-4c39-bd37-027f48dd6a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef4de62-bdf4-4154-9aa6-d5153321cc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef4de62-bdf4-4154-9aa6-d5153321cc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1530938348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7f78e1-ff09-4f34-85fa-2de1a289a170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566e3541cf4946dd82ca1473af13b777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:38Z,use_quota=True,user_id='3b3dae31f3ae4f32b11dc1f8f227fc28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcac480-5e36-41d1-90d4-defbdb4fed99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcac480-5e36-41d1-90d4-defbdb4fed99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff93b92-75e6-4971-b1ef-b7b9ceafa8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff93b92-75e6-4971-b1ef-b7b9ceafa8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e7f78e1-ff09-4f34-85fa-2de1a289a170', 'volume_name': 'volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8a9991-0e3e-4b32-9933-90d419786470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8a9991-0e3e-4b32-9933-90d419786470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731c86f1-b657-43e6-b1f6-85a1466e9c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Volume 5e7f78e1-ff09-4f34-85fa-2de1a289a170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170', 'volume_size': 1} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (14d05ce6-b27c-4c7e-bd81-53c03232dcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151b397e-8011-4e96-87d0-3f818200a99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (151b397e-8011-4e96-87d0-3f818200a99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-904089877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef254654-e586-4aa0-addd-c0d5a86a54a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:38Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1681660f-d633-4716-829b-f5cc2e489088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1681660f-d633-4716-829b-f5cc2e489088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4270ab0b-ee92-4cd9-b900-c81e98a5f5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4270ab0b-ee92-4cd9-b900-c81e98a5f5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef254654-e586-4aa0-addd-c0d5a86a54a4', 'volume_name': 'volume-ef254654-e586-4aa0-addd-c0d5a86a54a4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2abcc1-9f57-4c2c-aadc-3753a167dba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2abcc1-9f57-4c2c-aadc-3753a167dba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bc0bd0-4ba6-4402-82fb-65abc4bccb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume ef254654-e586-4aa0-addd-c0d5a86a54a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef254654-e586-4aa0-addd-c0d5a86a54a4', 'volume_size': 1} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (cbd5eda9-df1b-42d7-b043-9214b7a96a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c72bf0-b25b-4dbc-ad9f-de08ec894b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c72bf0-b25b-4dbc-ad9f-de08ec894b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2037368508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535198b7-d352-4045-ab17-97ee00a41011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:38Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3eb1f86-7a29-43d5-804b-0ac95d93a74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3eb1f86-7a29-43d5-804b-0ac95d93a74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ce59d5-5bf0-4448-915c-e06860432a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ce59d5-5bf0-4448-915c-e06860432a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535198b7-d352-4045-ab17-97ee00a41011', 'volume_name': 'volume-535198b7-d352-4045-ab17-97ee00a41011', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ea8f04-81f7-4270-ba79-143bcbe1bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ea8f04-81f7-4270-ba79-143bcbe1bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beee6e0a-0444-46a2-a6c3-ae139dea979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume 535198b7-d352-4045-ab17-97ee00a41011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535198b7-d352-4045-ab17-97ee00a41011', 'volume_size': 1} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6" returned: 0 in 0.684s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1227209888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba14997d-561a-46bb-89f8-01948caf1675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c51e6e98bd941819443fe6cc278de8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:37Z,use_quota=True,user_id='ffbc9be0096843369e7f5a4c615deac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Creating volume ba14997d-561a-46bb-89f8-01948caf1675 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:38 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:38 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675 1073741824 Apr 24 19:18:38 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3db44fa-6caa-4e39-b5fa-580684c87688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f9f5d6-77e5-4a07-a291-064048366cd6', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5295db-8c17-4432-944b-edcb29256b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Volume volume-89f9f5d6-77e5-4a07-a291-064048366cd6 (89f9f5d6-77e5-4a07-a291-064048366cd6): created successfully Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5295db-8c17-4432-944b-edcb29256b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (421e30e2-db84-416f-a4ba-646b074a030e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:38 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-aeef0e61-9b46-4ff3-a21a-d509ec0716a6 tempest-VolumesActionsTest-846024063 None] Created volume successfully. Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (9c847cf7-5c33-44de-8f20-38cad9232895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc87b4f-d41f-4c58-91e4-9c1c21b61301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc87b4f-d41f-4c58-91e4-9c1c21b61301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1374018445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59bb801-f48a-43a4-894f-89c29c8df913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:39Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb47036-c177-4ab5-b0df-0b0d597ebe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb47036-c177-4ab5-b0df-0b0d597ebe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8329514-4bff-4e58-bf59-6c5489811d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8329514-4bff-4e58-bf59-6c5489811d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59bb801-f48a-43a4-894f-89c29c8df913', 'volume_name': 'volume-c59bb801-f48a-43a4-894f-89c29c8df913', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c39f2ba-609c-4169-a414-253de0485ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c39f2ba-609c-4169-a414-253de0485ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a595d4-bec5-4a5a-94e7-429ecb2740db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:38 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume c59bb801-f48a-43a4-894f-89c29c8df913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59bb801-f48a-43a4-894f-89c29c8df913', 'volume_size': 1} Apr 24 19:18:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Acquiring lock "cinder-89f9f5d6-77e5-4a07-a291-064048366cd6-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Lock "cinder-89f9f5d6-77e5-4a07-a291-064048366cd6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:39 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675 1073741824" returned: 0 in 0.820s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Acquiring lock "cinder-quobyte-89f9f5d6-77e5-4a07-a291-064048366cd6" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Lock "cinder-quobyte-89f9f5d6-77e5-4a07-a291-064048366cd6" acquired by "delete_volume" :: waited 0.037s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:39 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[328692f2-4e70-40eb-a079-b5a21f53757c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:39 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675 Apr 24 19:18:39 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:39 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6 Apr 24 19:18:39 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:40 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675" returned: 0 in 0.559s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.609s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1324100351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab81e4ee-cb2d-4f83-b42f-a586b06eef71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:37Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Creating volume ab81e4ee-cb2d-4f83-b42f-a586b06eef71 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:40 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae31b37-ddb6-4715-bbfa-4ee506fdc6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba14997d-561a-46bb-89f8-01948caf1675', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0601384-9189-4bc7-8a88-b8a03ac8a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:40 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71 1073741824 Apr 24 19:18:40 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:40 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Volume volume-ba14997d-561a-46bb-89f8-01948caf1675 (ba14997d-561a-46bb-89f8-01948caf1675): created successfully Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0601384-9189-4bc7-8a88-b8a03ac8a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Flow 'volume_create_manager' (45e4bc8f-c3a1-49bb-8e0d-24dc583a5b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:40 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6" returned: 0 in 0.631s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:40 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-94c048aa-c9a1-427d-b787-bdeab141c64d tempest-VolumeQuotasAdminTestJSON-1839591460 None] Created volume successfully. Apr 24 19:18:40 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6 Apr 24 19:18:40 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Acquiring lock "cinder-ba14997d-561a-46bb-89f8-01948caf1675-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "cinder-ba14997d-561a-46bb-89f8-01948caf1675-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Acquiring lock "cinder-quobyte-ba14997d-561a-46bb-89f8-01948caf1675" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "cinder-quobyte-ba14997d-561a-46bb-89f8-01948caf1675" acquired by "delete_volume" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ad7c59-5d6f-435a-8313-ecea4be7e5ec]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:40 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675 Apr 24 19:18:40 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:40 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89f9f5d6-77e5-4a07-a291-064048366cd6" returned: 0 in 0.577s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Lock "cinder-quobyte-89f9f5d6-77e5-4a07-a291-064048366cd6" released by "delete_volume" :: held 1.262s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Created reservations ['f11c581a-1e12-42c4-a128-a5e8d675ea31', 'b8756823-323a-413f-b5bc-0fd26a3b082a', '92b760cb-d6b2-4149-acb8-6fb97abc42b8', '1c54378d-ba2d-4e61-a38c-bf5990d29171'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:40 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71 1073741824" returned: 0 in 0.798s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:40 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:40 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:41 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71 Apr 24 19:18:41 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:41 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675" returned: 0 in 0.632s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:41 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675 Apr 24 19:18:41 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:41 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71" returned: 0 in 0.568s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.663s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-458356333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec466bac-3806-41fd-9cd5-ee12f819c369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:38Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Creating volume ec466bac-3806-41fd-9cd5-ee12f819c369 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:41 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ea67a0-c767-4b89-a13c-dbc87dd48c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170e6e18-c4db-4619-ae77-b3a9e7b54909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:41 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:41 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369 1073741824 Apr 24 19:18:41 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.700s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:41 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Deleted volume successfully. Apr 24 19:18:41 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71 (ab81e4ee-cb2d-4f83-b42f-a586b06eef71): created successfully Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170e6e18-c4db-4619-ae77-b3a9e7b54909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (574be5de-f42f-43e6-9049-1867812d10b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:41 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-bcaf64a7-133b-482f-b259-69a4c8b531da tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created volume successfully. Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8f82108d-3c6f-4b76-b435-d483fdaef898 tempest-VolumesActionsTest-404350273 None] Lock "cinder-89f9f5d6-77e5-4a07-a291-064048366cd6-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:41 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ba14997d-561a-46bb-89f8-01948caf1675" returned: 0 in 0.655s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "cinder-quobyte-ba14997d-561a-46bb-89f8-01948caf1675" released by "delete_volume" :: held 1.346s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:41 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Created reservations ['e909f4c5-177c-47d1-a9fd-97b410825a9a', '77232f56-ba6b-4e10-b500-604012bee893', '02dffd8d-01ae-48c3-8be2-343e45db46a6', '7de657dc-0ce7-4bab-b8b5-1c43f6fa07cb'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:42 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:42 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (7435207e-d6e8-4799-a03e-51d49e7e6b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc60a1e-7f53-4ca9-8cde-3960c526a16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc60a1e-7f53-4ca9-8cde-3960c526a16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2100420732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54df6b7c-02e7-4423-ac91-ff01fde57a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:42Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0af1472-35ce-4191-9f59-fcc51ae24ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0af1472-35ce-4191-9f59-fcc51ae24ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba2fcbc-0caf-4b60-bea0-002fbe2f3d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ba2fcbc-0caf-4b60-bea0-002fbe2f3d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54df6b7c-02e7-4423-ac91-ff01fde57a25', 'volume_name': 'volume-54df6b7c-02e7-4423-ac91-ff01fde57a25', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b283b9-6f07-4280-baf9-ef10fcfef5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b283b9-6f07-4280-baf9-ef10fcfef5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c3c035-c232-43d0-94d9-f718c2702ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:42 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Volume 54df6b7c-02e7-4423-ac91-ff01fde57a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54df6b7c-02e7-4423-ac91-ff01fde57a25', 'volume_size': 1} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:42 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369 1073741824" returned: 0 in 0.894s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:42 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369 Apr 24 19:18:42 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:42 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.598s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:42 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Deleted volume successfully. Apr 24 19:18:42 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2014af95-cb60-40ac-9df6-691c5a16b137 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "cinder-ba14997d-561a-46bb-89f8-01948caf1675-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:43 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369" returned: 0 in 0.547s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.756s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1530938348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7f78e1-ff09-4f34-85fa-2de1a289a170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566e3541cf4946dd82ca1473af13b777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:38Z,use_quota=True,user_id='3b3dae31f3ae4f32b11dc1f8f227fc28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Creating volume 5e7f78e1-ff09-4f34-85fa-2de1a289a170 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:43 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:43 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170 1073741824 Apr 24 19:18:43 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d487d3ac-22a5-4f32-b808-9164d58efb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec466bac-3806-41fd-9cd5-ee12f819c369', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d9375f-b53e-4e86-8392-de7c9eb845e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:43 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume volume-ec466bac-3806-41fd-9cd5-ee12f819c369 (ec466bac-3806-41fd-9cd5-ee12f819c369): created successfully Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d9375f-b53e-4e86-8392-de7c9eb845e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (14071248-ad9e-4190-b1a5-60f8af4cab9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:43 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4ef68c3e-aa39-47b4-b027-1297eafed499 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created volume successfully. Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Flow 'volume_create_manager' (d8fc75ba-2186-4ae2-b401-d160b8a9aae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0883b528-fe63-4886-8b97-187420d632ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0883b528-fe63-4886-8b97-187420d632ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2012592812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c51e6e98bd941819443fe6cc278de8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:43Z,use_quota=True,user_id='ffbc9be0096843369e7f5a4c615deac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d70b32-3469-46ca-a9ed-b4acb7631aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d70b32-3469-46ca-a9ed-b4acb7631aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc288aa-6591-4f4c-b0f7-bb328a7e771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc288aa-6591-4f4c-b0f7-bb328a7e771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0', 'volume_name': 'volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3c124f-21e2-4043-88d5-2ceb3b54cb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3c124f-21e2-4043-88d5-2ceb3b54cb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cc2fed-3034-44ed-8a89-5ab7a207a235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:43 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Volume 8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0', 'volume_size': 1} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:43 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170 1073741824" returned: 0 in 0.733s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:43 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170 Apr 24 19:18:43 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:44 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170" returned: 0 in 0.525s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.960s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-904089877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef254654-e586-4aa0-addd-c0d5a86a54a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:38Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Creating volume ef254654-e586-4aa0-addd-c0d5a86a54a4 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:44 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731c86f1-b657-43e6-b1f6-85a1466e9c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:44 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4 1073741824 Apr 24 19:18:44 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a6f476-668b-45cd-a61d-06bf6c065bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:44 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Volume volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170 (5e7f78e1-ff09-4f34-85fa-2de1a289a170): created successfully Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a6f476-668b-45cd-a61d-06bf6c065bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Flow 'volume_create_manager' (7b325d5a-ce3d-4c39-bd37-027f48dd6a9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:44 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-597830e1-fbcf-45ec-b263-c1c50050baae tempest-VolumesListAdminTestJSON-775952720 None] Created volume successfully. Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Flow 'volume_create_manager' (ad3a15c5-f378-4691-be6a-6e1b7f927791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1060792f-1ffa-430e-b337-b3e640e7c2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:45 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4 1073741824" returned: 0 in 0.849s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1060792f-1ffa-430e-b337-b3e640e7c2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1455654473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e85f737-776c-4ab1-97b9-ecae0b61916f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566e3541cf4946dd82ca1473af13b777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:45Z,use_quota=True,user_id='3b3dae31f3ae4f32b11dc1f8f227fc28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d1c8f0-be2e-4105-8fbf-96287f52af37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d1c8f0-be2e-4105-8fbf-96287f52af37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf760ed9-3461-4e50-8e37-eba0ae9c5871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf760ed9-3461-4e50-8e37-eba0ae9c5871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e85f737-776c-4ab1-97b9-ecae0b61916f', 'volume_name': 'volume-6e85f737-776c-4ab1-97b9-ecae0b61916f', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6269ca8b-4280-4b5f-a04f-30f81136624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6269ca8b-4280-4b5f-a04f-30f81136624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab94723c-11f0-420e-8172-89f2f7ed1aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:45 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Volume 6e85f737-776c-4ab1-97b9-ecae0b61916f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e85f737-776c-4ab1-97b9-ecae0b61916f', 'volume_size': 1} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:45 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4 Apr 24 19:18:45 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:45 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4" returned: 0 in 0.486s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.163s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2037368508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535198b7-d352-4045-ab17-97ee00a41011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:38Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Creating volume 535198b7-d352-4045-ab17-97ee00a41011 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:45 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bc0bd0-4ba6-4402-82fb-65abc4bccb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef254654-e586-4aa0-addd-c0d5a86a54a4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:45 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011 1073741824 Apr 24 19:18:45 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4037f5-6f7b-4893-95a1-a0e821b08a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:45 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume volume-ef254654-e586-4aa0-addd-c0d5a86a54a4 (ef254654-e586-4aa0-addd-c0d5a86a54a4): created successfully Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4037f5-6f7b-4893-95a1-a0e821b08a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (14d05ce6-b27c-4c7e-bd81-53c03232dcb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:45 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0ce52e4d-3719-4273-8333-bf1afe8e8fdc tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created volume successfully. Apr 24 19:18:46 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011 1073741824" returned: 0 in 0.809s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:46 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011 Apr 24 19:18:46 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:47 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011" returned: 0 in 0.534s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.203s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1374018445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59bb801-f48a-43a4-894f-89c29c8df913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040cbc94898b46b9ae46107198b36892',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:39Z,use_quota=True,user_id='2bd4ce6cfa0a47cabe2d13c191ee4a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Creating volume c59bb801-f48a-43a4-894f-89c29c8df913 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:47 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beee6e0a-0444-46a2-a6c3-ae139dea979d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535198b7-d352-4045-ab17-97ee00a41011', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:47 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913 1073741824 Apr 24 19:18:47 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f5fb19-ecf0-4531-b53a-52ffcddcc9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:47 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume volume-535198b7-d352-4045-ab17-97ee00a41011 (535198b7-d352-4045-ab17-97ee00a41011): created successfully Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f5fb19-ecf0-4531-b53a-52ffcddcc9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (cbd5eda9-df1b-42d7-b043-9214b7a96a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:47 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-dba5a05e-d5e6-4e98-af21-bd4dab2d67db tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created volume successfully. Apr 24 19:18:47 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913 1073741824" returned: 0 in 0.760s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:48 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913 Apr 24 19:18:48 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:48 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913" returned: 0 in 0.547s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.213s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2100420732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54df6b7c-02e7-4423-ac91-ff01fde57a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:42Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Creating volume 54df6b7c-02e7-4423-ac91-ff01fde57a25 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:48 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:48 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25 1073741824 Apr 24 19:18:48 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a595d4-bec5-4a5a-94e7-429ecb2740db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59bb801-f48a-43a4-894f-89c29c8df913', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd97df5b-e937-49da-8fab-ea38ec635eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:48 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Volume volume-c59bb801-f48a-43a4-894f-89c29c8df913 (c59bb801-f48a-43a4-894f-89c29c8df913): created successfully Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd97df5b-e937-49da-8fab-ea38ec635eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Flow 'volume_create_manager' (9c847cf7-5c33-44de-8f20-38cad9232895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:48 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-130cab21-9a3f-4535-89d3-0368d62613fe tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created volume successfully. Apr 24 19:18:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-c59bb801-f48a-43a4-894f-89c29c8df913-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-c59bb801-f48a-43a4-894f-89c29c8df913-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-quobyte-c59bb801-f48a-43a4-894f-89c29c8df913" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-c59bb801-f48a-43a4-894f-89c29c8df913" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:49 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba942f9d-cff4-43f4-952e-4f1e7737eba4]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:49 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913 Apr 24 19:18:49 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:49 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25 1073741824" returned: 0 in 0.824s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:49 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25 Apr 24 19:18:49 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:49 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913" returned: 0 in 0.684s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:49 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913 Apr 24 19:18:49 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:50 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25" returned: 0 in 0.578s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.766s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2012592812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c51e6e98bd941819443fe6cc278de8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:43Z,use_quota=True,user_id='ffbc9be0096843369e7f5a4c615deac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Creating volume 8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:50 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:50 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0 1073741824 Apr 24 19:18:50 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c3c035-c232-43d0-94d9-f718c2702ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54df6b7c-02e7-4423-ac91-ff01fde57a25', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c01343-99b7-49b6-b7db-a20f6a08bb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:50 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Volume volume-54df6b7c-02e7-4423-ac91-ff01fde57a25 (54df6b7c-02e7-4423-ac91-ff01fde57a25): created successfully Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c01343-99b7-49b6-b7db-a20f6a08bb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (7435207e-d6e8-4799-a03e-51d49e7e6b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:50 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-74cd30f3-71d6-41fc-ad38-156c88c1d74a tempest-VolumesActionsTest-846024063 None] Created volume successfully. Apr 24 19:18:50 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c59bb801-f48a-43a4-894f-89c29c8df913" returned: 0 in 0.579s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-c59bb801-f48a-43a4-894f-89c29c8df913" released by "delete_volume" :: held 1.311s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created reservations ['8e8dc86b-5cd9-438f-8174-700e260de83e', '446087a9-ae8f-44dc-8caa-b4fa8d84fe9a', '87f31766-0127-4c36-9165-969191d09ee7', 'f4154a4a-b116-409a-874b-30f5c6fcb9c3'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:50 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:50 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:50 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0 1073741824" returned: 0 in 0.900s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Acquiring lock "cinder-54df6b7c-02e7-4423-ac91-ff01fde57a25-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Lock "cinder-54df6b7c-02e7-4423-ac91-ff01fde57a25-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:51 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0 Apr 24 19:18:51 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Acquiring lock "cinder-quobyte-54df6b7c-02e7-4423-ac91-ff01fde57a25" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Lock "cinder-quobyte-54df6b7c-02e7-4423-ac91-ff01fde57a25" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afcfdf5-9ba4-416f-b87e-6bd5c1313408]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:51 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.625s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:51 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Deleted volume successfully. Apr 24 19:18:51 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25 Apr 24 19:18:51 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d77fb71a-532f-4796-adcf-0348a3165a50 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-c59bb801-f48a-43a4-894f-89c29c8df913-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-535198b7-d352-4045-ab17-97ee00a41011-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-535198b7-d352-4045-ab17-97ee00a41011-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-quobyte-535198b7-d352-4045-ab17-97ee00a41011" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-535198b7-d352-4045-ab17-97ee00a41011" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[57da8215-7aaa-43f2-aabe-b8e8106c82ea]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:51 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011 Apr 24 19:18:51 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:51 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0" returned: 0 in 0.693s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.450s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1455654473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e85f737-776c-4ab1-97b9-ecae0b61916f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566e3541cf4946dd82ca1473af13b777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:45Z,use_quota=True,user_id='3b3dae31f3ae4f32b11dc1f8f227fc28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Creating volume 6e85f737-776c-4ab1-97b9-ecae0b61916f {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:51 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:51 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f 1073741824 Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55cc2fed-3034-44ed-8a89-5ab7a207a235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:51 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b50cce8-0622-426c-9211-e4e5f4cb28b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:51 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Volume volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0 (8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0): created successfully Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b50cce8-0622-426c-9211-e4e5f4cb28b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Flow 'volume_create_manager' (d8fc75ba-2186-4ae2-b401-d160b8a9aae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:51 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-ea9f5ed4-c051-4fc0-9a92-7a96153171c0 tempest-VolumeQuotasAdminTestJSON-1839591460 None] Created volume successfully. Apr 24 19:18:51 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25" returned: 0 in 0.693s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:51 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25 Apr 24 19:18:51 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:52 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011" returned: 0 in 0.699s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:52 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011 Apr 24 19:18:52 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:52 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-54df6b7c-02e7-4423-ac91-ff01fde57a25" returned: 0 in 0.515s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Lock "cinder-quobyte-54df6b7c-02e7-4423-ac91-ff01fde57a25" released by "delete_volume" :: held 1.267s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Created reservations ['6a7f072e-b2b0-4926-a5fd-9229f22f6a5b', 'a76682b2-8055-4be7-abd5-6d3c341bc4ee', '7bbe29d6-6cd4-4194-b97c-fded18892740', '2960b1ca-8815-4836-8a80-8f021e8b702b'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:52 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f 1073741824" returned: 0 in 0.813s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:52 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:52 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:52 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f Apr 24 19:18:52 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:52 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-535198b7-d352-4045-ab17-97ee00a41011" returned: 0 in 0.616s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-535198b7-d352-4045-ab17-97ee00a41011" released by "delete_volume" :: held 1.361s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created reservations ['9718fcc4-eed9-4bcf-87f1-6bfe96fbdff5', '331d2cef-f382-46e6-aac0-191238f1160d', '555d1fd7-e037-4265-b7e9-0c923687c030', '19563085-64a3-4ef1-b962-1c1a0c278eeb'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:52 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:52 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:53 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f" returned: 0 in 0.567s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab94723c-11f0-420e-8172-89f2f7ed1aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e85f737-776c-4ab1-97b9-ecae0b61916f', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86dc6392-9e9d-490a-b53a-69c8a87b8a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:53 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.669s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:53 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Deleted volume successfully. Apr 24 19:18:53 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Volume volume-6e85f737-776c-4ab1-97b9-ecae0b61916f (6e85f737-776c-4ab1-97b9-ecae0b61916f): created successfully Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86dc6392-9e9d-490a-b53a-69c8a87b8a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Flow 'volume_create_manager' (ad3a15c5-f378-4691-be6a-6e1b7f927791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:53 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-27234c2d-7b4e-4c67-aa12-6d13a713316e tempest-VolumesListAdminTestJSON-775952720 None] Created volume successfully. Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1de06bf2-501d-4380-b693-01641ca1bee7 tempest-VolumesActionsTest-404350273 None] Lock "cinder-54df6b7c-02e7-4423-ac91-ff01fde57a25-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:53 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.585s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:53 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Deleted volume successfully. Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1d74fb1b-f1c3-4bdf-a7a4-6bf10ea158b9 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-535198b7-d352-4045-ab17-97ee00a41011-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:53 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3ccf172a-ded4-412b-9568-0fc42985eef5 tempest-VolumeQuotasAdminTestJSON-1831828362 None] Transfer volume completed successfully. Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (45e7659f-9222-4fb2-8885-72b7566f22e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7153d4c7-ff00-4338-bfb1-cf6ea1980fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7153d4c7-ff00-4338-bfb1-cf6ea1980fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-446932491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4ac793-ee68-48fa-b316-1a885bf1da7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:54Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb8981d-717a-4b0a-889c-f5a76c3314ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb8981d-717a-4b0a-889c-f5a76c3314ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118cc6b4-fe9b-40bf-b5d0-262bab66dc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118cc6b4-fe9b-40bf-b5d0-262bab66dc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4ac793-ee68-48fa-b316-1a885bf1da7c', 'volume_name': 'volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf62615-603c-429d-a28c-63b4f4d6f02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf62615-603c-429d-a28c-63b4f4d6f02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9c1877-a5a4-41df-bfd3-c5f03b7a5e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:53 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Volume 1b4ac793-ee68-48fa-b316-1a885bf1da7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c', 'volume_size': 1} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-446932491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4ac793-ee68-48fa-b316-1a885bf1da7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:54Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Creating volume 1b4ac793-ee68-48fa-b316-1a885bf1da7c {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:53 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-ef254654-e586-4aa0-addd-c0d5a86a54a4-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:53 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c 1073741824 Apr 24 19:18:53 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-ef254654-e586-4aa0-addd-c0d5a86a54a4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-quobyte-ef254654-e586-4aa0-addd-c0d5a86a54a4" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-ef254654-e586-4aa0-addd-c0d5a86a54a4" acquired by "delete_volume" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ded110c-874b-46b6-80cd-871d4bd024b3]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:54 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4 Apr 24 19:18:54 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Flow 'volume_create_manager' (03e21967-36b1-4dd5-99a7-229de5c26aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37cddb7-a4c7-431e-82fe-f61d19fde459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37cddb7-a4c7-431e-82fe-f61d19fde459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-620126039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9764f0e4-8334-466c-9f5f-7adf69ff629c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566e3541cf4946dd82ca1473af13b777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:55Z,use_quota=True,user_id='3b3dae31f3ae4f32b11dc1f8f227fc28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770464ab-4d58-44af-b820-854862a40e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770464ab-4d58-44af-b820-854862a40e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839ac206-be5c-4bc6-aa85-090e24b2387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839ac206-be5c-4bc6-aa85-090e24b2387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9764f0e4-8334-466c-9f5f-7adf69ff629c', 'volume_name': 'volume-9764f0e4-8334-466c-9f5f-7adf69ff629c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57593913-0515-408d-a9d7-2ae2cb4c72fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57593913-0515-408d-a9d7-2ae2cb4c72fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac2834c-8b37-455e-830c-b73731774b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:54 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Volume 9764f0e4-8334-466c-9f5f-7adf69ff629c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9764f0e4-8334-466c-9f5f-7adf69ff629c', 'volume_size': 1} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Acquiring lock "cinder-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Lock "cinder-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Acquiring lock "cinder-quobyte-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Lock "cinder-quobyte-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0" acquired by "delete_volume" :: waited 0.030s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2749d2b7-9295-4bc8-bcac-8b094a3abd38]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:54 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c 1073741824" returned: 0 in 0.994s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:55 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c Apr 24 19:18:55 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:55 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0 Apr 24 19:18:55 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:55 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4" returned: 0 in 0.959s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:55 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4 Apr 24 19:18:55 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:55 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c" returned: 0 in 0.552s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-620126039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9764f0e4-8334-466c-9f5f-7adf69ff629c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566e3541cf4946dd82ca1473af13b777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:55Z,use_quota=True,user_id='3b3dae31f3ae4f32b11dc1f8f227fc28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Creating volume 9764f0e4-8334-466c-9f5f-7adf69ff629c {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:55 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:55 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0" returned: 0 in 0.659s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:55 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c 1073741824 Apr 24 19:18:55 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9c1877-a5a4-41df-bfd3-c5f03b7a5e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8616524-8230-470c-baa7-3450d02c8087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:55 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0 Apr 24 19:18:55 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:55 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Volume volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c (1b4ac793-ee68-48fa-b316-1a885bf1da7c): created successfully Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8616524-8230-470c-baa7-3450d02c8087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (45e7659f-9222-4fb2-8885-72b7566f22e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:55 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-632acfa9-42a1-43a2-ae8c-e206678cb2f6 tempest-VolumesActionsTest-846024063 None] Created volume successfully. Apr 24 19:18:55 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ef254654-e586-4aa0-addd-c0d5a86a54a4" returned: 0 in 0.630s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-ef254654-e586-4aa0-addd-c0d5a86a54a4" released by "delete_volume" :: held 1.636s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created reservations ['378f5058-898c-4e26-aa2c-d405d92cdb81', '7e714b7e-21c3-4dde-b510-a1f0dc1e7aba', 'f33db8d2-f9ea-4b73-bdec-865eab36a607', '8f08d37d-fb9d-42c6-b78e-2bb588a06e63'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:55 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:55 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:56 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0" returned: 0 in 0.513s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Lock "cinder-quobyte-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0" released by "delete_volume" :: held 1.225s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Created reservations ['1af62711-648a-491a-b634-c01312774327', 'fb997675-86a1-44f3-8d03-3b1a7fa70bf9', 'add4a448-2dd4-4a14-9c81-ab856c4d50e2', '474223f1-3603-487c-9206-3e82cb016079'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-ec466bac-3806-41fd-9cd5-ee12f819c369-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Acquiring lock "cinder-1b4ac793-ee68-48fa-b316-1a885bf1da7c-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Lock "cinder-1b4ac793-ee68-48fa-b316-1a885bf1da7c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-ec466bac-3806-41fd-9cd5-ee12f819c369-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Acquiring lock "cinder-quobyte-1b4ac793-ee68-48fa-b316-1a885bf1da7c" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-quobyte-ec466bac-3806-41fd-9cd5-ee12f819c369" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Lock "cinder-quobyte-1b4ac793-ee68-48fa-b316-1a885bf1da7c" acquired by "delete_volume" :: waited 0.030s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:56 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5a00d3-fecd-459b-ad68-b0852207d5bb]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:56 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:56 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c 1073741824" returned: 0 in 0.977s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:56 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-ec466bac-3806-41fd-9cd5-ee12f819c369" acquired by "delete_volume" :: waited 0.087s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.716s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f097cfc-1e28-4c4b-9a70-d70eeb7b052e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:56 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Deleted volume successfully. Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9feab591-bbb4-43a2-83b0-3d9b60f91a87 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-ef254654-e586-4aa0-addd-c0d5a86a54a4-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:56 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c Apr 24 19:18:56 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:56 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c Apr 24 19:18:56 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:56 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369 Apr 24 19:18:56 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:57 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.660s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:57 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Deleted volume successfully. Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6491d58e-1e30-4759-8f76-f42bf79833b6 tempest-VolumeQuotasAdminTestJSON-526127145 None] Lock "cinder-8fb41a3c-52ec-4bb8-8bcb-ed9b63975fc0-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:57 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c" returned: 0 in 0.600s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=112,cinder:UPDATE=168,cinder:INSERT=32,cinder:DELETE=18 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac2834c-8b37-455e-830c-b73731774b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9764f0e4-8334-466c-9f5f-7adf69ff629c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5febfeed-1d4a-4637-9ccb-4c5baa55de1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:57 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:57 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Volume volume-9764f0e4-8334-466c-9f5f-7adf69ff629c (9764f0e4-8334-466c-9f5f-7adf69ff629c): created successfully Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5febfeed-1d4a-4637-9ccb-4c5baa55de1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Flow 'volume_create_manager' (03e21967-36b1-4dd5-99a7-229de5c26aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369" returned: 0 in 0.809s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:57 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-5fb294ed-fe48-4380-848a-039fb0ed5536 tempest-VolumesListAdminTestJSON-775952720 None] Created volume successfully. Apr 24 19:18:57 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369 Apr 24 19:18:57 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c" returned: 0 in 0.915s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:57 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:57 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c Apr 24 19:18:57 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:57 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ec466bac-3806-41fd-9cd5-ee12f819c369" returned: 0 in 0.526s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-ec466bac-3806-41fd-9cd5-ee12f819c369" released by "delete_volume" :: held 1.385s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:57 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created reservations ['80a3f5e0-00e5-4a53-a0b6-71bbe89c7976', 'e5d62618-df9f-4d8a-9b64-70f2c10819bd', 'fa430a93-b0a4-42ea-aa9e-c4652fcb56aa', '64004464-9fd2-41b3-8a74-1e228469d8bf'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:58 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1b4ac793-ee68-48fa-b316-1a885bf1da7c" returned: 0 in 0.645s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Lock "cinder-quobyte-1b4ac793-ee68-48fa-b316-1a885bf1da7c" released by "delete_volume" :: held 1.674s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:58 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:58 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Created reservations ['ee6859bd-33eb-4835-b6af-fe8b4b516b4f', '979f5cfa-c912-495c-bb02-535498925b1a', 'b3f3a308-c110-491e-86f5-e85a6a315e0c', 'ae721cfe-20ee-4a61-a120-2e006e57da88'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:58 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:58 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:58 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:18:58 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-ab81e4ee-cb2d-4f83-b42f-a586b06eef71-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Flow 'volume_create_manager' (2c60b39b-7e4e-4785-9903-082e19ff684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d0e0e0-acee-44a6-b22e-32b2b427877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d0e0e0-acee-44a6-b22e-32b2b427877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5a6211-4289-4946-9efc-8a7112d127f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da49041ad51e4187b832801b4862ec6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:59Z,use_quota=True,user_id='46117720b66542cc92bfe4e64d0a8006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcfd4fe-cc7a-4554-90b3-0b7f781ad298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcfd4fe-cc7a-4554-90b3-0b7f781ad298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527499d4-fd51-4eed-9380-2ed55d37c3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527499d4-fd51-4eed-9380-2ed55d37c3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5a6211-4289-4946-9efc-8a7112d127f1', 'volume_name': 'volume-ee5a6211-4289-4946-9efc-8a7112d127f1', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f28c2a7-f0c7-4824-be41-74d140078625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f28c2a7-f0c7-4824-be41-74d140078625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ec9b77-d617-421a-92ed-f1fc6d80a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:59 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Volume ee5a6211-4289-4946-9efc-8a7112d127f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5a6211-4289-4946-9efc-8a7112d127f1', 'volume_size': 1} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5a6211-4289-4946-9efc-8a7112d127f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da49041ad51e4187b832801b4862ec6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:59Z,use_quota=True,user_id='46117720b66542cc92bfe4e64d0a8006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Creating volume ee5a6211-4289-4946-9efc-8a7112d127f1 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:18:59 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-ab81e4ee-cb2d-4f83-b42f-a586b06eef71-delete_volume" acquired by "delete_volume" :: waited 0.429s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:59 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1 1073741824 Apr 24 19:18:59 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-quobyte-ab81e4ee-cb2d-4f83-b42f-a586b06eef71" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-ab81e4ee-cb2d-4f83-b42f-a586b06eef71" acquired by "delete_volume" :: waited 0.058s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:18:59 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.905s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[88441ea1-9ccb-42a2-9de1-a042530749c6]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:18:59 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.128s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:59 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Deleted volume successfully. Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (78b3bb7d-cd2f-4253-8566-f71247168285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92edc0b0-f00e-4dfc-8b29-5e7ca49acbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:59 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71 Apr 24 19:18:59 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0e234a32-ac78-4797-a335-66c7f4930474 tempest-VolumesActionsTest-404350273 None] Lock "cinder-1b4ac793-ee68-48fa-b316-1a885bf1da7c-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92edc0b0-f00e-4dfc-8b29-5e7ca49acbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014991623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5621cc-4aa8-4070-899c-28c83202f834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:59Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15f3ace-c1d7-446b-87e7-a63289d5304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15f3ace-c1d7-446b-87e7-a63289d5304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232bf2c8-032c-449c-b12f-b892a1a7ee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232bf2c8-032c-449c-b12f-b892a1a7ee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5621cc-4aa8-4070-899c-28c83202f834', 'volume_name': 'volume-3b5621cc-4aa8-4070-899c-28c83202f834', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea17f62e-fe7e-434d-b6e1-441a10633f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea17f62e-fe7e-434d-b6e1-441a10633f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8338aa01-4d59-4cdf-a7ea-5d8845a5db4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:18:59 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Volume 3b5621cc-4aa8-4070-899c-28c83202f834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5621cc-4aa8-4070-899c-28c83202f834', 'volume_size': 1} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:18:59 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.545s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:18:59 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Deleted volume successfully. Apr 24 19:18:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7963ed61-64ef-4ac2-abbe-815033aa35ce tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-ec466bac-3806-41fd-9cd5-ee12f819c369-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:00 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71" returned: 0 in 0.985s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:00 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71 Apr 24 19:19:00 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:00 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1 1073741824" returned: 0 in 1.278s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:00 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1 Apr 24 19:19:00 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:00 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ab81e4ee-cb2d-4f83-b42f-a586b06eef71" returned: 0 in 0.668s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:00 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-ab81e4ee-cb2d-4f83-b42f-a586b06eef71" released by "delete_volume" :: held 1.722s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:01 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1" returned: 0 in 0.667s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014991623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5621cc-4aa8-4070-899c-28c83202f834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:18:59Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Creating volume 3b5621cc-4aa8-4070-899c-28c83202f834 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:01 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created reservations ['95337a47-1934-4659-85df-ac40436ef531', '005b8c8d-9b66-43e9-bb9d-a68cf1855b21', '2205fa86-5664-4d92-a418-6789e12911bf', 'ed664526-4060-45a6-8973-acb98cf23ab3'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ec9b77-d617-421a-92ed-f1fc6d80a00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5a6211-4289-4946-9efc-8a7112d127f1', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:01 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834 1073741824 Apr 24 19:19:01 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1ac0d5-7b31-47d3-85c6-7030fe49c0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:01 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Volume volume-ee5a6211-4289-4946-9efc-8a7112d127f1 (ee5a6211-4289-4946-9efc-8a7112d127f1): created successfully Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1ac0d5-7b31-47d3-85c6-7030fe49c0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Flow 'volume_create_manager' (2c60b39b-7e4e-4785-9903-082e19ff684e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-f1da6ba5-d1da-4f7e-964e-a92e282df854 tempest-VolumesListAdminTestJSON-588562098 None] Created volume successfully. Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:01 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:01 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:01 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.645s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Deleted volume successfully. Apr 24 19:19:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f537367a-47a7-498f-a6b5-a613269b8d69 tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-ab81e4ee-cb2d-4f83-b42f-a586b06eef71-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:02 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834 1073741824" returned: 0 in 0.965s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Acquiring lock "cinder-ee5a6211-4289-4946-9efc-8a7112d127f1-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Lock "cinder-ee5a6211-4289-4946-9efc-8a7112d127f1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-79fd354d-c0fa-4cb2-827d-063278c7c808-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Acquiring lock "cinder-quobyte-ee5a6211-4289-4946-9efc-8a7112d127f1" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:02 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834 Apr 24 19:19:02 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-79fd354d-c0fa-4cb2-827d-063278c7c808-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Lock "cinder-quobyte-ee5a6211-4289-4946-9efc-8a7112d127f1" acquired by "delete_volume" :: waited 0.030s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "cinder-9764f0e4-8334-466c-9f5f-7adf69ff629c-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8e7a0f-400c-4673-9669-04bb0a76ac2a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-9764f0e4-8334-466c-9f5f-7adf69ff629c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:02 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1 Apr 24 19:19:02 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "cinder-quobyte-9764f0e4-8334-466c-9f5f-7adf69ff629c" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "cinder-quobyte-79fd354d-c0fa-4cb2-827d-063278c7c808" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-quobyte-9764f0e4-8334-466c-9f5f-7adf69ff629c" acquired by "delete_volume" :: waited 0.026s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-79fd354d-c0fa-4cb2-827d-063278c7c808" acquired by "delete_volume" :: waited 0.039s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f332d2-f310-4868-805e-33539b0e6d95]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d458bd9-6dac-47f6-aef5-836f2f2bacb1]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:02 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808 Apr 24 19:19:02 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:02 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c Apr 24 19:19:02 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:03 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834" returned: 0 in 0.881s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8338aa01-4d59-4cdf-a7ea-5d8845a5db4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5621cc-4aa8-4070-899c-28c83202f834', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb134125-240c-4d7c-a246-51b4f0a76375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:03 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Volume volume-3b5621cc-4aa8-4070-899c-28c83202f834 (3b5621cc-4aa8-4070-899c-28c83202f834): created successfully Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb134125-240c-4d7c-a246-51b4f0a76375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (78b3bb7d-cd2f-4253-8566-f71247168285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:03 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-643134cc-8981-4bc1-9503-395effadedc0 tempest-VolumesActionsTest-846024063 None] Created volume successfully. Apr 24 19:19:03 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1" returned: 0 in 0.932s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:03 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1 Apr 24 19:19:03 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:03 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808" returned: 0 in 0.906s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:03 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c" returned: 0 in 0.947s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:03 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808 Apr 24 19:19:03 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:03 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c Apr 24 19:19:03 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:03 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee5a6211-4289-4946-9efc-8a7112d127f1" returned: 0 in 0.722s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:03 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Lock "cinder-quobyte-ee5a6211-4289-4946-9efc-8a7112d127f1" released by "delete_volume" :: held 1.721s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Acquiring lock "cinder-3b5621cc-4aa8-4070-899c-28c83202f834-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Created reservations ['d0a7fa02-0be1-413b-be3c-c7fe25513d1a', '6d80d8d4-3e5c-488a-b9dc-8f31127f3796', '3ed9c647-0625-47be-97d0-d2755aac0d53', '28e20a3d-6506-41ee-bc85-c3fc906f7b5d'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Lock "cinder-3b5621cc-4aa8-4070-899c-28c83202f834-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Acquiring lock "cinder-quobyte-3b5621cc-4aa8-4070-899c-28c83202f834" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Lock "cinder-quobyte-3b5621cc-4aa8-4070-899c-28c83202f834" acquired by "delete_volume" :: waited 0.037s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96686f9-162a-4525-af76-ff871f122403]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:04 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9764f0e4-8334-466c-9f5f-7adf69ff629c" returned: 0 in 0.801s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-quobyte-9764f0e4-8334-466c-9f5f-7adf69ff629c" released by "delete_volume" :: held 1.822s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:04 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:04 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:04 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834 Apr 24 19:19:04 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Created reservations ['c2c5b9a3-7772-4a68-a7cc-e7b81609b96e', '46da46c1-6f31-4ea3-b6a1-188ac0f9ff61', 'd16d705e-bb31-4eac-b329-8962b37508f9', '42e788a2-0f40-450f-8f68-332ed010daed'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:04 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:04 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:04 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-79fd354d-c0fa-4cb2-827d-063278c7c808" returned: 0 in 1.056s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-quobyte-79fd354d-c0fa-4cb2-827d-063278c7c808" released by "delete_volume" :: held 2.029s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Created reservations ['382e09b2-b6b9-45cb-922d-e5ba64310a80', '119f3324-7249-4744-b993-e4793c9a4db2', '08ebcc78-7ff4-40b1-a249-f0be00e869db', 'fa474962-752a-4d4a-ad4d-6aad9897f81e'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "cinder-6e85f737-776c-4ab1-97b9-ecae0b61916f-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-6e85f737-776c-4ab1-97b9-ecae0b61916f-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "cinder-quobyte-6e85f737-776c-4ab1-97b9-ecae0b61916f" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-quobyte-6e85f737-776c-4ab1-97b9-ecae0b61916f" acquired by "delete_volume" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:05 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:05 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9c05b8-8d90-450d-8f24-595d70aebcc6]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:05 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834" returned: 0 in 0.990s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:05 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f Apr 24 19:19:05 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:05 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834 Apr 24 19:19:05 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:05 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.058s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:05 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Deleted volume successfully. Apr 24 19:19:05 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.311s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:05 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Deleted volume successfully. Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-85317bc5-dea9-44ef-91e3-4c6cf5d6d5ca tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-9764f0e4-8334-466c-9f5f-7adf69ff629c-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b3444e4a-4d66-4244-9abf-0acd09eca137 tempest-VolumesListAdminTestJSON-588562098 None] Lock "cinder-ee5a6211-4289-4946-9efc-8a7112d127f1-delete_volume" released by "delete_volume" :: held 3.583s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:05 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3b5621cc-4aa8-4070-899c-28c83202f834" returned: 0 in 0.696s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Lock "cinder-quobyte-3b5621cc-4aa8-4070-899c-28c83202f834" released by "delete_volume" :: held 1.748s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:06 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.998s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:06 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Deleted volume successfully. Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Created reservations ['924f7fa7-99f8-4458-85fd-4ce8f2d888e9', 'c5ace453-1bbc-4564-8e20-eb016bfd3b7c', '5edf27d4-32f8-4f19-a444-2b6345178085', '267684cf-11b4-409b-bc06-d00cdc2b9101'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0669e72d-b56d-4f71-b84b-9ef7a11f92de tempest-CreateVolumesFromSourceVolumeTest-1820642974 None] Lock "cinder-79fd354d-c0fa-4cb2-827d-063278c7c808-delete_volume" released by "delete_volume" :: held 3.888s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:06 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:06 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:06 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f" returned: 0 in 1.132s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:06 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f Apr 24 19:19:06 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:06 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6e85f737-776c-4ab1-97b9-ecae0b61916f" returned: 0 in 0.712s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-quobyte-6e85f737-776c-4ab1-97b9-ecae0b61916f" released by "delete_volume" :: held 1.923s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Created reservations ['c7ae8878-a4ff-4d47-a443-58ae3969b9c1', '3cabcae3-502a-480f-8fc4-4fb80429c230', '0b8a7eeb-a5a3-4aaa-bc93-993f32e99c2d', 'c247b549-ee07-4c67-bd03-fc0e914fb82a'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:07 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (6e24b2bc-1914-4f8e-a2b1-27b8d9439159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a541a0-dc9f-4f4b-8a4d-3d7c1e9d6716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.040s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a541a0-dc9f-4f4b-8a4d-3d7c1e9d6716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302972145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2798eba1-9a94-4d6c-beb0-9543d7b37b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:07Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1988ffdf-ffa7-4cf5-90e6-9b4623c6a671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1988ffdf-ffa7-4cf5-90e6-9b4623c6a671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f614ac-c46f-4c37-b43d-443d26c7321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51f614ac-c46f-4c37-b43d-443d26c7321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2798eba1-9a94-4d6c-beb0-9543d7b37b43', 'volume_name': 'volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fda4885-7abf-44a6-9512-5476d7c8ec7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fda4885-7abf-44a6-9512-5476d7c8ec7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a218dbf-0e02-4349-820d-b65bbe24f46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:07 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Volume 2798eba1-9a94-4d6c-beb0-9543d7b37b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43', 'volume_size': 1} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302972145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2798eba1-9a94-4d6c-beb0-9543d7b37b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d13ef475699482183f74e87f803440e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:07Z,use_quota=True,user_id='afa3612d0a3a465a886489a0ef574846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Creating volume 2798eba1-9a94-4d6c-beb0-9543d7b37b43 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:07 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:07 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Deleted volume successfully. Apr 24 19:19:07 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43 1073741824 Apr 24 19:19:07 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-76ed21ef-390b-40de-a809-b818aa1953a4 tempest-VolumesActionsTest-404350273 None] Lock "cinder-3b5621cc-4aa8-4070-899c-28c83202f834-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "cinder-5e7f78e1-ff09-4f34-85fa-2de1a289a170-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:07 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:07 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-5e7f78e1-ff09-4f34-85fa-2de1a289a170-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "cinder-quobyte-5e7f78e1-ff09-4f34-85fa-2de1a289a170" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-quobyte-5e7f78e1-ff09-4f34-85fa-2de1a289a170" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9919ce7e-6bca-4a96-9110-bfc123b1a230]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:07 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170 Apr 24 19:19:07 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:08 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.811s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:08 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Deleted volume successfully. Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7164f02d-508a-4c92-af08-d39ba948db5b tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-6e85f737-776c-4ab1-97b9-ecae0b61916f-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:08 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Flow 'volume_create_manager' (38699f72-9536-4661-8fc5-9f6c345bd1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0147ed-11fd-4e1a-81b5-61e4688a017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43 1073741824" returned: 0 in 1.106s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0147ed-11fd-4e1a-81b5-61e4688a017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-691616760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf5738c-fbf9-483b-8310-1c61380edf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186d1155a4c141f5af2eff5b551363e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:08Z,use_quota=True,user_id='e246c645bd174a1e9db94d207f34aa80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971f29aa-b988-4f3b-97f8-2b34c46d1f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971f29aa-b988-4f3b-97f8-2b34c46d1f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd17645-e535-49e2-978b-d876dfced1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd17645-e535-49e2-978b-d876dfced1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf5738c-fbf9-483b-8310-1c61380edf30', 'volume_name': 'volume-5bf5738c-fbf9-483b-8310-1c61380edf30', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8835252a-09f3-4cff-8abe-b711d49d5f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8835252a-09f3-4cff-8abe-b711d49d5f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9563c81c-367d-4b30-be37-60b62112c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:08 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Volume 5bf5738c-fbf9-483b-8310-1c61380edf30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf5738c-fbf9-483b-8310-1c61380edf30', 'volume_size': 1} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:08 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43 Apr 24 19:19:08 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:08 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170" returned: 0 in 1.043s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:08 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170 Apr 24 19:19:08 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:09 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43" returned: 0 in 0.616s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-691616760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf5738c-fbf9-483b-8310-1c61380edf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186d1155a4c141f5af2eff5b551363e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:08Z,use_quota=True,user_id='e246c645bd174a1e9db94d207f34aa80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Creating volume 5bf5738c-fbf9-483b-8310-1c61380edf30 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:09 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:09 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a218dbf-0e02-4349-820d-b65bbe24f46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:09 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30 1073741824 Apr 24 19:19:09 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e986d6a5-fecb-4537-b0c5-8d0f66aa6345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5e7f78e1-ff09-4f34-85fa-2de1a289a170" returned: 0 in 0.560s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:09 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Volume volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43 (2798eba1-9a94-4d6c-beb0-9543d7b37b43): created successfully Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e986d6a5-fecb-4537-b0c5-8d0f66aa6345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Flow 'volume_create_manager' (6e24b2bc-1914-4f8e-a2b1-27b8d9439159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-quobyte-5e7f78e1-ff09-4f34-85fa-2de1a289a170" released by "delete_volume" :: held 1.686s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:09 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-20c165ee-7193-4a06-822d-57817fb2d105 tempest-VolumesActionsTest-846024063 None] Created volume successfully. Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Created reservations ['e993363d-5e4b-4d15-9db9-48a8ed1e7e2d', 'ac0ceb99-7df4-4593-bcd7-68d37d3e0abd', '9413488e-f8f2-491f-a252-3056e32110f8', 'bbbcbc1d-d26c-4bcd-8be7-5917f0abddda'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:09 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:09 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:10 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.688s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:10 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:10 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Deleted volume successfully. Apr 24 19:19:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-572e4df7-3121-4910-b834-6cb94d4d095b tempest-VolumesListAdminTestJSON-775952720 None] Lock "cinder-5e7f78e1-ff09-4f34-85fa-2de1a289a170-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:10 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30 1073741824" returned: 0 in 1.286s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Acquiring lock "cinder-2798eba1-9a94-4d6c-beb0-9543d7b37b43-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Lock "cinder-2798eba1-9a94-4d6c-beb0-9543d7b37b43-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:10 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30 Apr 24 19:19:10 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Acquiring lock "cinder-quobyte-2798eba1-9a94-4d6c-beb0-9543d7b37b43" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Lock "cinder-quobyte-2798eba1-9a94-4d6c-beb0-9543d7b37b43" acquired by "delete_volume" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:10 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4462dfd-30ab-420d-849e-e029de7f2409]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:10 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43 Apr 24 19:19:10 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:11 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30" returned: 0 in 0.795s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9563c81c-367d-4b30-be37-60b62112c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf5738c-fbf9-483b-8310-1c61380edf30', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9d5d80-d5eb-4b1d-b9e6-5899b0c835dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:11 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Volume volume-5bf5738c-fbf9-483b-8310-1c61380edf30 (5bf5738c-fbf9-483b-8310-1c61380edf30): created successfully Apr 24 19:19:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9d5d80-d5eb-4b1d-b9e6-5899b0c835dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Flow 'volume_create_manager' (38699f72-9536-4661-8fc5-9f6c345bd1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:11 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-992a5ca0-2e4d-43be-91bb-1ddff937449c tempest-VolumesServicesTestJSON-516124531 None] Created volume successfully. Apr 24 19:19:11 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43" returned: 0 in 0.862s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:11 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43 Apr 24 19:19:11 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Acquiring lock "cinder-5bf5738c-fbf9-483b-8310-1c61380edf30-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Lock "cinder-5bf5738c-fbf9-483b-8310-1c61380edf30-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Acquiring lock "cinder-quobyte-5bf5738c-fbf9-483b-8310-1c61380edf30" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Lock "cinder-quobyte-5bf5738c-fbf9-483b-8310-1c61380edf30" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0f4d56-650c-49bc-b70d-811056eb3a6e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:12 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30 Apr 24 19:19:12 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:12 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2798eba1-9a94-4d6c-beb0-9543d7b37b43" returned: 0 in 0.754s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Lock "cinder-quobyte-2798eba1-9a94-4d6c-beb0-9543d7b37b43" released by "delete_volume" :: held 1.662s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Created reservations ['62e9d0e3-3c3e-40a5-9193-e84fc382673b', '28562ac7-2341-4b76-b791-8a8b7f6301bf', 'ae82e5e4-e018-477e-8c1f-de8b5e925321', 'c815d6ef-beb4-4626-8966-269592d10928'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:12 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:12 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:12 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30" returned: 0 in 0.785s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:12 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30 Apr 24 19:19:12 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:13 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.669s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:13 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Deleted volume successfully. Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92788b8c-19a4-40f0-ae5a-b16e0e0e8f52 tempest-VolumesActionsTest-846024063 None] Lock "cinder-2798eba1-9a94-4d6c-beb0-9543d7b37b43-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:13 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5bf5738c-fbf9-483b-8310-1c61380edf30" returned: 0 in 0.768s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Lock "cinder-quobyte-5bf5738c-fbf9-483b-8310-1c61380edf30" released by "delete_volume" :: held 1.618s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Created reservations ['a3c95902-17fd-4656-9437-a87fce1adff7', '27efd993-45ca-4349-99a6-33160cb7688f', '9342576a-895c-469e-a58d-86272dd641c9', 'b83e627e-745a-4b86-bed2-2a667a2be539'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:13 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:13 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:14 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.015s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:14 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:14 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Deleted volume successfully. Apr 24 19:19:14 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ed03a69b-329c-4e67-969b-1fed62463866 tempest-VolumesServicesTestJSON-516124531 None] Lock "cinder-5bf5738c-fbf9-483b-8310-1c61380edf30-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:23 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=141,cinder:INSERT=50,cinder:UPDATE=232,cinder:DELETE=13 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Flow 'volume_create_manager' (0744393a-5dbb-4cfa-b985-91f1dc9190d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd6fa69-c818-4ef4-9fe4-a8e3f23eb56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd6fa69-c818-4ef4-9fe4-a8e3f23eb56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1814429499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895c5c25-ae24-43b6-9b42-a5e4edac9329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde92a6fd2404db4a338fbd2d8fe3b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:24Z,use_quota=True,user_id='53369c91e4dc4dec821ff1ad2d0e8aed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28a6349-eb9d-4384-96e6-b218fe83f74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28a6349-eb9d-4384-96e6-b218fe83f74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfee4e36-c620-4c36-ad95-ca29a92b8fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfee4e36-c620-4c36-ad95-ca29a92b8fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '895c5c25-ae24-43b6-9b42-a5e4edac9329', 'volume_name': 'volume-895c5c25-ae24-43b6-9b42-a5e4edac9329', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872c5703-c1e7-4e44-a054-d0e5228067db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872c5703-c1e7-4e44-a054-d0e5228067db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75d5180-b2ad-4dfa-b8f3-05ad9dfafc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:24 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Volume 895c5c25-ae24-43b6-9b42-a5e4edac9329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-895c5c25-ae24-43b6-9b42-a5e4edac9329', 'volume_size': 1} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1814429499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895c5c25-ae24-43b6-9b42-a5e4edac9329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde92a6fd2404db4a338fbd2d8fe3b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:24Z,use_quota=True,user_id='53369c91e4dc4dec821ff1ad2d0e8aed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Creating volume 895c5c25-ae24-43b6-9b42-a5e4edac9329 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:24 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:19:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:24 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329 1073741824 Apr 24 19:19:24 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:25 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329 1073741824" returned: 0 in 1.232s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:25 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329 Apr 24 19:19:25 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:26 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329" returned: 0 in 0.640s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75d5180-b2ad-4dfa-b8f3-05ad9dfafc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895c5c25-ae24-43b6-9b42-a5e4edac9329', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe0a9239-8256-41d2-b38a-035e3a617e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:26 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Volume volume-895c5c25-ae24-43b6-9b42-a5e4edac9329 (895c5c25-ae24-43b6-9b42-a5e4edac9329): created successfully Apr 24 19:19:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe0a9239-8256-41d2-b38a-035e3a617e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Flow 'volume_create_manager' (0744393a-5dbb-4cfa-b985-91f1dc9190d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:26 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-8266b6ad-1d0d-449f-b299-6c4af5368ac9 tempest-VolumesTransfersTest-1954498656 None] Created volume successfully. Apr 24 19:19:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-b2e5a50a-a6e3-4167-b643-17b15d790391 tempest-VolumesTransfersTest-503910535 None] Transfer volume completed successfully. Apr 24 19:19:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Acquiring lock "cinder-895c5c25-ae24-43b6-9b42-a5e4edac9329-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Lock "cinder-895c5c25-ae24-43b6-9b42-a5e4edac9329-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Acquiring lock "cinder-quobyte-895c5c25-ae24-43b6-9b42-a5e4edac9329" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Lock "cinder-quobyte-895c5c25-ae24-43b6-9b42-a5e4edac9329" acquired by "delete_volume" :: waited 0.026s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:30 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba10b2d7-5c07-48fd-b837-01ebdcd41a3d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:30 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329 Apr 24 19:19:30 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:30 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329" returned: 0 in 0.835s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:30 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329 Apr 24 19:19:30 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:31 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-895c5c25-ae24-43b6-9b42-a5e4edac9329" returned: 0 in 0.755s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Lock "cinder-quobyte-895c5c25-ae24-43b6-9b42-a5e4edac9329" released by "delete_volume" :: held 1.654s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:31 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Created reservations ['2e60117d-5151-46e1-8ce9-e2c56c8c3c22', '6ed482d1-c5e9-4486-967c-152d820cef2e', '241d6004-ec09-40f6-a860-ac9112c5d7ce', '1f3a7f13-9485-4a57-8277-006be62f2bb9'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:31 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:31 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:31 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:31 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:32 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.552s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:32 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Deleted volume successfully. Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d1ed6fe7-48b5-4a17-bbdd-1c4d7a319b10 tempest-VolumesTransfersTest-246602792 None] Lock "cinder-895c5c25-ae24-43b6-9b42-a5e4edac9329-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Flow 'volume_create_manager' (318ab394-ebc8-444f-9e64-d2dd971702b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf49c59-893e-4e25-a2c8-e9e3f3c15ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf49c59-893e-4e25-a2c8-e9e3f3c15ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-667902278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1a00b7-c3cf-40e5-925a-270489b53da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde92a6fd2404db4a338fbd2d8fe3b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:33Z,use_quota=True,user_id='53369c91e4dc4dec821ff1ad2d0e8aed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f0625a-353c-47ff-bbe8-8eda04a86133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f0625a-353c-47ff-bbe8-8eda04a86133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f3ff7b-eeeb-4120-8127-2c6738e76b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f3ff7b-eeeb-4120-8127-2c6738e76b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1a00b7-c3cf-40e5-925a-270489b53da6', 'volume_name': 'volume-9c1a00b7-c3cf-40e5-925a-270489b53da6', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a907ee-b224-49b2-b527-84a2f59d3dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a907ee-b224-49b2-b527-84a2f59d3dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eede24a8-de40-4f91-a8c2-5ee3d4b1c882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:32 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Volume 9c1a00b7-c3cf-40e5-925a-270489b53da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1a00b7-c3cf-40e5-925a-270489b53da6', 'volume_size': 1} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-667902278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1a00b7-c3cf-40e5-925a-270489b53da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde92a6fd2404db4a338fbd2d8fe3b62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:33Z,use_quota=True,user_id='53369c91e4dc4dec821ff1ad2d0e8aed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Creating volume 9c1a00b7-c3cf-40e5-925a-270489b53da6 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:32 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:19:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:33 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6 1073741824 Apr 24 19:19:33 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:34 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6 1073741824" returned: 0 in 1.084s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:34 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6 Apr 24 19:19:34 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Flow 'volume_create_manager' (c98539b5-6fa9-41c4-a382-a6c43e9d26e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7116989e-d13e-4099-a27a-8b234a855a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7116989e-d13e-4099-a27a-8b234a855a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1462065324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d879af-e9f4-4add-a99e-a77972e66b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ed2e5df1ac410080177847ac5bfd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:34Z,use_quota=True,user_id='1c7a17f9a994473d874c8f8f4975978d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec36d27-69dc-4f9a-a065-7c66156a2116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec36d27-69dc-4f9a-a065-7c66156a2116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d18f59a-b420-49a5-99fe-06ee0c52e42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d18f59a-b420-49a5-99fe-06ee0c52e42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d879af-e9f4-4add-a99e-a77972e66b07', 'volume_name': 'volume-c4d879af-e9f4-4add-a99e-a77972e66b07', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b552f9eb-4eeb-428c-949c-87c0877ac341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b552f9eb-4eeb-428c-949c-87c0877ac341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be155c5-bd5a-4931-b851-65b08fa55830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:34 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Volume c4d879af-e9f4-4add-a99e-a77972e66b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d879af-e9f4-4add-a99e-a77972e66b07', 'volume_size': 1} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:34 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6" returned: 0 in 0.719s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1462065324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d879af-e9f4-4add-a99e-a77972e66b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ed2e5df1ac410080177847ac5bfd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:34Z,use_quota=True,user_id='1c7a17f9a994473d874c8f8f4975978d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Creating volume c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:34 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eede24a8-de40-4f91-a8c2-5ee3d4b1c882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1a00b7-c3cf-40e5-925a-270489b53da6', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6176a453-0e66-48c2-8c5f-ffefa34e1178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:34 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 1073741824 Apr 24 19:19:34 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:34 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Volume volume-9c1a00b7-c3cf-40e5-925a-270489b53da6 (9c1a00b7-c3cf-40e5-925a-270489b53da6): created successfully Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6176a453-0e66-48c2-8c5f-ffefa34e1178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Flow 'volume_create_manager' (318ab394-ebc8-444f-9e64-d2dd971702b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:34 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-607e82a4-a15b-4698-9168-2c2f9d646382 tempest-VolumesTransfersTest-1954498656 None] Created volume successfully. Apr 24 19:19:35 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 1073741824" returned: 0 in 0.960s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:35 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 Apr 24 19:19:35 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Acquiring lock "cinder-9c1a00b7-c3cf-40e5-925a-270489b53da6-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Lock "cinder-9c1a00b7-c3cf-40e5-925a-270489b53da6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Acquiring lock "cinder-quobyte-9c1a00b7-c3cf-40e5-925a-270489b53da6" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Lock "cinder-quobyte-9c1a00b7-c3cf-40e5-925a-270489b53da6" acquired by "delete_volume" :: waited 0.036s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:36 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07" returned: 0 in 1.056s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c5485e-b29b-4909-806c-b1cfbf8c935f]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be155c5-bd5a-4931-b851-65b08fa55830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d879af-e9f4-4add-a99e-a77972e66b07', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d883bc2-d0b2-422b-9c77-01e2a84c4705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:36 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Volume volume-c4d879af-e9f4-4add-a99e-a77972e66b07 (c4d879af-e9f4-4add-a99e-a77972e66b07): created successfully Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d883bc2-d0b2-422b-9c77-01e2a84c4705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:36 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Flow 'volume_create_manager' (c98539b5-6fa9-41c4-a382-a6c43e9d26e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:37 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-f4a64d99-418f-4d5b-a2dc-574d795dfdff tempest-VolumesDeleteCascade-233682129 None] Created volume successfully. Apr 24 19:19:37 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6 Apr 24 19:19:37 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Flow 'volume_create_manager' (0b107ae3-5c7e-4abd-b0e2-2040f554f960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2baee70f-a173-4a40-b683-857fb6819132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2baee70f-a173-4a40-b683-857fb6819132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1517535887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c320a6f-2e0b-417e-8904-3ece6695bcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ce3032753c4651a4d6c67edff9ef54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:37Z,use_quota=True,user_id='3a8b6c2a5cc44b6482adaab550559fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdf92a1-d5cb-4097-9469-1ffd5c90c652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdf92a1-d5cb-4097-9469-1ffd5c90c652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73a682d-6bfa-486c-ba35-5f885adfde89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.image.glance [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Creating Keystone auth plugin from conf {{(pid=82057) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] Creating offline snapshot 786a0f93-6c47-45a3-8715-3c15e79cb67e of volume c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee249f7-aa75-4532-9d85-dffd1124fd03]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:37 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 Apr 24 19:19:37 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73a682d-6bfa-486c-ba35-5f885adfde89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c320a6f-2e0b-417e-8904-3ece6695bcb1', 'volume_name': 'volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10d2ca7-e673-4be0-8f2b-55bc56f23297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10d2ca7-e673-4be0-8f2b-55bc56f23297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:37 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add61033-467f-4a2c-922e-65430019e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:37 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Volume 1c320a6f-2e0b-417e-8904-3ece6695bcb1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:19:37 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Trying to clone 1c320a6f-2e0b-417e-8904-3ece6695bcb1 from image 89fa23e1-262a-416b-b193-8f71185c7514 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]). {{(pid=82057) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:19:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6" returned: 0 in 1.103s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:38 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6 Apr 24 19:19:38 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:38 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:19:38 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:19:38 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c867f366-2bd6-44ac-80f7-7cc4a9cbef40]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:38 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD Apr 24 19:19:38 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:38 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07" returned: 0 in 1.069s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:38 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9c1a00b7-c3cf-40e5-925a-270489b53da6" returned: 0 in 0.864s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:38 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e 1G Apr 24 19:19:38 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Lock "cinder-quobyte-9c1a00b7-c3cf-40e5-925a-270489b53da6" released by "delete_volume" :: held 2.048s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:38 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Created reservations ['3e1ef472-19a1-4bbc-a6c9-0ed024bdc9a2', '00681686-a720-4fbd-baf3-a75229127714', '42695656-8ac3-417a-b66b-ff06692e55cd', '7a601469-d90a-426d-8cc4-975d09e887ed'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:39 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:39 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD" returned: 0 in 0.831s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Temporary image 89fa23e1-262a-416b-b193-8f71185c7514 is fetched for user 3a8b6c2a5cc44b6482adaab550559fbf. {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:19:39 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccba682-ac1e-4970-b01d-f94d51e0a8b1]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:39 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD Apr 24 19:19:39 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:39 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.789s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:39 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Deleted volume successfully. Apr 24 19:19:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59a69326-f124-461c-82a8-33b683b3dbf7 tempest-VolumesTransfersTest-246602792 None] Lock "cinder-9c1a00b7-c3cf-40e5-925a-270489b53da6-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:40 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e 1G" returned: 0 in 1.256s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d879af-e9f4-4add-a99e-a77972e66b07 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:40 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d879af-e9f4-4add-a99e-a77972e66b07 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e Apr 24 19:19:40 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:40 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD" returned: 0 in 1.028s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:41 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d879af-e9f4-4add-a99e-a77972e66b07 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e" returned: 0 in 0.980s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:41 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e is being set with open permissions: ugo+rw Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:41 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e Apr 24 19:19:41 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:41 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Flow 'volume_create_manager' (c6a3b7b2-559d-436a-84ca-751968e5d011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13bf5e4f-9afd-441a-a037-7ccdbcc699a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e" returned: 0 in 0.669s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13bf5e4f-9afd-441a-a037-7ccdbcc699a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-92805635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2d7ead-e073-4eb3-86b7-4de80fd4c842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842d705b946347e3889c03ea15226d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:42Z,use_quota=True,user_id='2080ac09c1374151873ddde7eb3c8944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd8f37e-b052-476d-9f17-5cb492ecd1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd8f37e-b052-476d-9f17-5cb492ecd1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac27c317-a6f5-4c8b-9e34-37fb363d6349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac27c317-a6f5-4c8b-9e34-37fb363d6349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d2d7ead-e073-4eb3-86b7-4de80fd4c842', 'volume_name': 'volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bbf5ee-639e-49a4-8176-208f6d13a2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75bbf5ee-639e-49a4-8176-208f6d13a2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31854e9a-2dd3-4ef3-81ff-8462f9343966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:41 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Volume 4d2d7ead-e073-4eb3-86b7-4de80fd4c842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842', 'volume_size': 1} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:41 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.info Apr 24 19:19:41 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:42 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.info" returned: 0 in 0.605s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:42 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.info is being set with open permissions: ugo+rw Apr 24 19:19:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:42 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.info Apr 24 19:19:42 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:43 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.info" returned: 0 in 0.574s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.325s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.403s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1517535887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c320a6f-2e0b-417e-8904-3ece6695bcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10ce3032753c4651a4d6c67edff9ef54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:37Z,use_quota=True,user_id='3a8b6c2a5cc44b6482adaab550559fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Creating volume 1c320a6f-2e0b-417e-8904-3ece6695bcb1 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:43 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:43 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 1073741824 Apr 24 19:19:43 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:43 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c3e54f87-c5e1-43a9-94dc-adb4650a5fa7 tempest-VolumesDeleteCascade-233682129 None] Create snapshot completed successfully Apr 24 19:19:43 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 1073741824" returned: 0 in 0.772s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:43 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 Apr 24 19:19:43 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:44 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1" returned: 0 in 0.618s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.677s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-92805635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2d7ead-e073-4eb3-86b7-4de80fd4c842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842d705b946347e3889c03ea15226d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:42Z,use_quota=True,user_id='2080ac09c1374151873ddde7eb3c8944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Creating volume 4d2d7ead-e073-4eb3-86b7-4de80fd4c842 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:44 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:44 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 1073741824 Apr 24 19:19:44 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Attempting download of 89fa23e1-262a-416b-b193-8f71185c7514 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}])) to volume 1c320a6f-2e0b-417e-8904-3ece6695bcb1. {{(pid=82057) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b847f80-a90a-4d2c-bd2e-874ea4279401]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_tknhxuxt {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:44 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_tknhxuxt Apr 24 19:19:44 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:45 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_tknhxuxt" returned: 0 in 0.726s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_tknhxuxt {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:45 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 1073741824" returned: 0 in 0.868s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:45 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_tknhxuxt Apr 24 19:19:45 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:45 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 Apr 24 19:19:45 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:45 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:45 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_tknhxuxt" returned: 1 in 0.598s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_tknhxuxt' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d39179-cc5b-459d-9fa7-fc8894be370f]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" returned: 0 in 0.533s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.670s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31854e9a-2dd3-4ef3-81ff-8462f9343966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d01d66-db1b-43b5-9ce9-083fd054125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] Creating offline snapshot 7c0c4e20-8f2b-435e-89fd-d895930d9ca7 of volume c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:19:46 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD Apr 24 19:19:46 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:46 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Volume volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 (4d2d7ead-e073-4eb3-86b7-4de80fd4c842): created successfully Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d01d66-db1b-43b5-9ce9-083fd054125f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Flow 'volume_create_manager' (c6a3b7b2-559d-436a-84ca-751968e5d011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51ac14e-317c-48ee-9f39-d60d97f68201]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:46 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6180cb7d-4dac-4d0c-94fa-01f3963ebda3 tempest-SnapshotDependencyTests-2085942436 None] Created volume successfully. Apr 24 19:19:46 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e Apr 24 19:19:46 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:46 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD" returned: 0 in 0.688s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] 89fa23e1-262a-416b-b193-8f71185c7514 was qcow2, converting to raw {{(pid=82057) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:46 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 Apr 24 19:19:46 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:46 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e" returned: 0 in 0.677s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d879af-e9f4-4add-a99e-a77972e66b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:19:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:46 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 1G Apr 24 19:19:46 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Flow 'volume_create_manager' (1d93e8ea-f5a6-408e-914d-b35c5c53e064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b441b8b-f757-4987-ab03-02bd4a038afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b441b8b-f757-4987-ab03-02bd4a038afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1662659217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b48d001-b25d-4f13-8e72-97bcb40e52c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da85431fb84e44ae85b1a61e9d6ef1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:47Z,use_quota=True,user_id='fc054f53d2864457a7ed9992f95e04f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e20589-071c-4f79-a055-a58c516c3a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e20589-071c-4f79-a055-a58c516c3a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8dd235d-1fdd-4338-8f0c-165fbe4e2213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8dd235d-1fdd-4338-8f0c-165fbe4e2213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b48d001-b25d-4f13-8e72-97bcb40e52c0', 'volume_name': 'volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06cb7fc-509d-40c8-8f2e-5ecc9fa3a5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06cb7fc-509d-40c8-8f2e-5ecc9fa3a5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41028094-0dd9-45af-acc1-85a87006fdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:47 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Volume 5b48d001-b25d-4f13-8e72-97bcb40e52c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0', 'volume_size': 1} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:47 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 1G" returned: 0 in 1.033s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:47 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 Apr 24 19:19:47 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:48 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7" returned: 0 in 0.725s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:48 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 is being set with open permissions: ugo+rw Apr 24 19:19:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:48 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 Apr 24 19:19:48 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:48 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1" returned: 0 in 2.112s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:48 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_iysritvddevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:19:48 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Converted 112.00 MB image at 53.00 MB/s Apr 24 19:19:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:48 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 1G Apr 24 19:19:48 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:49 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7" returned: 0 in 0.539s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.121s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.934s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1662659217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b48d001-b25d-4f13-8e72-97bcb40e52c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da85431fb84e44ae85b1a61e9d6ef1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:47Z,use_quota=True,user_id='fc054f53d2864457a7ed9992f95e04f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Creating volume 5b48d001-b25d-4f13-8e72-97bcb40e52c0 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:49 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:49 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0 1073741824 Apr 24 19:19:49 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:49 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-52247bd8-f5dd-497d-afc6-deb1a7e702c5 tempest-VolumesDeleteCascade-233682129 None] Create snapshot completed successfully Apr 24 19:19:49 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 1G" returned: 0 in 0.609s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5f6e8c-a783-4f38-8692-bad9bb5879ec]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:49 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 Apr 24 19:19:49 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-c4d879af-e9f4-4add-a99e-a77972e66b07-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-c4d879af-e9f4-4add-a99e-a77972e66b07-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Performing cascade delete. {{(pid=82057) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-786a0f93-6c47-45a3-8715-3c15e79cb67e-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-786a0f93-6c47-45a3-8715-3c15e79cb67e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-quobyte-c4d879af-e9f4-4add-a99e-a77972e66b07" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-c4d879af-e9f4-4add-a99e-a77972e66b07" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-quobyte-786a0f93-6c47-45a3-8715-3c15e79cb67e" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-786a0f93-6c47-45a3-8715-3c15e79cb67e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Deleting offline snapshot 786a0f93-6c47-45a3-8715-3c15e79cb67e of volume c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] snapshot_file for this snap is: volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8bc71a-54aa-4902-a994-1a3e242f854e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:49 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e Apr 24 19:19:49 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:49 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0 1073741824" returned: 0 in 0.849s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:50 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0 Apr 24 19:19:50 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:50 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1" returned: 0 in 0.788s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:50 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 Apr 24 19:19:50 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:50 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e" returned: 0 in 0.662s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d879af-e9f4-4add-a99e-a77972e66b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e06f76-62ef-459d-92d0-65bbbe0c1dc3]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:50 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0" returned: 0 in 0.586s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.155s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:50 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 Apr 24 19:19:50 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] Creating offline snapshot 5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 of volume 4d2d7ead-e073-4eb3-86b7-4de80fd4c842 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41028094-0dd9-45af-acc1-85a87006fdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc46b917-ff58-4065-b3ff-a4ba6a3726da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca557ee0-cc2c-4c91-bc24-9929714402ea]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:50 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Volume volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0 (5b48d001-b25d-4f13-8e72-97bcb40e52c0): created successfully Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc46b917-ff58-4065-b3ff-a4ba6a3726da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Flow 'volume_create_manager' (1d93e8ea-f5a6-408e-914d-b35c5c53e064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:50 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d125c48e-a04b-4fd6-a9c9-e8f9b5ab9c6d tempest-VolumesListTestJSON-328564144 None] Created volume successfully. Apr 24 19:19:50 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 Apr 24 19:19:50 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:50 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1" returned: 1 in 0.652s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Downloaded image 89fa23e1-262a-416b-b193-8f71185c7514 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}])) to volume 1c320a6f-2e0b-417e-8904-3ece6695bcb1 successfully. {{(pid=82057) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Temporary image 89fa23e1-262a-416b-b193-8f71185c7514 for user 3a8b6c2a5cc44b6482adaab550559fbf is deleted. {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Marking volume 1c320a6f-2e0b-417e-8904-3ece6695bcb1 as bootable. {{(pid=82057) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Copying metadata from image 89fa23e1-262a-416b-b193-8f71185c7514 to 1c320a6f-2e0b-417e-8904-3ece6695bcb1. {{(pid=82057) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Creating volume glance metadata for volume 1c320a6f-2e0b-417e-8904-3ece6695bcb1 backed by image 89fa23e1-262a-416b-b193-8f71185c7514 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82057) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add61033-467f-4a2c-922e-65430019e79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6920f3b5-088c-4c22-996e-2c5cc1f5a521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:50 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Volume volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 (1c320a6f-2e0b-417e-8904-3ece6695bcb1): created successfully Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6920f3b5-088c-4c22-996e-2c5cc1f5a521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Flow 'volume_create_manager' (0b107ae3-5c7e-4abd-b0e2-2040f554f960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:51 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-caf44cc4-a2f6-486b-a34a-49fb38e0834d tempest-VolumesImageMetadata-865239530 None] Created volume successfully. Apr 24 19:19:51 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07" returned: 0 in 0.629s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:51 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[92edb766-4596-4c6e-89ee-ef4d79663ae1]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:51 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 Apr 24 19:19:51 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:51 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" returned: 0 in 0.725s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:51 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 1G Apr 24 19:19:51 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:51 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Flow 'volume_create_manager' (b299d932-929a-45ed-8287-790fa73979af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c800502-079b-4d27-b4c7-7d511bc27b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c800502-079b-4d27-b4c7-7d511bc27b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-519056209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f25dc12-3bf0-47a8-901c-6747d4051535,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da85431fb84e44ae85b1a61e9d6ef1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:52Z,use_quota=True,user_id='fc054f53d2864457a7ed9992f95e04f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20935535-76f1-4f93-a441-e12aca335fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20935535-76f1-4f93-a441-e12aca335fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60260639-60f6-4248-a8ec-9ab30d52a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60260639-60f6-4248-a8ec-9ab30d52a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f25dc12-3bf0-47a8-901c-6747d4051535', 'volume_name': 'volume-8f25dc12-3bf0-47a8-901c-6747d4051535', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0897f5c9-8def-464f-8a92-ee864155bfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0897f5c9-8def-464f-8a92-ee864155bfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73da7793-1f52-4685-b3e6-2b96687eb660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:52 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:52 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Volume 8f25dc12-3bf0-47a8-901c-6747d4051535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f25dc12-3bf0-47a8-901c-6747d4051535', 'volume_size': 1} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7" returned: 0 in 0.877s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d879af-e9f4-4add-a99e-a77972e66b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda88d5c-9092-47a9-8db4-e60b140333ef]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Acquiring lock "cinder-1c320a6f-2e0b-417e-8904-3ece6695bcb1-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Lock "cinder-1c320a6f-2e0b-417e-8904-3ece6695bcb1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Acquiring lock "cinder-quobyte-1c320a6f-2e0b-417e-8904-3ece6695bcb1" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Lock "cinder-quobyte-1c320a6f-2e0b-417e-8904-3ece6695bcb1" acquired by "delete_volume" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:52 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e Apr 24 19:19:52 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[955f18dc-0044-46e0-a28b-c45db7152a1a]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:52 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 Apr 24 19:19:52 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:52 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 1G" returned: 0 in 0.970s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:52 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 Apr 24 19:19:52 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:52 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e" returned: 0 in 0.606s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d879af-e9f4-4add-a99e-a77972e66b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa8d026-9d07-4a53-a3b2-6bb1ccd4000b]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:52 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 Apr 24 19:19:52 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:52 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1" returned: 0 in 0.581s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:52 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 Apr 24 19:19:52 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:52 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3" returned: 0 in 0.627s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:52 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 is being set with open permissions: ugo+rw Apr 24 19:19:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:53 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 Apr 24 19:19:53 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:53 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07" returned: 0 in 0.596s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:53 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e Apr 24 19:19:53 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:53 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3" returned: 0 in 0.470s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:53 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1" returned: 1 in 0.633s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:19:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:53 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1 Apr 24 19:19:53 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:53 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.info Apr 24 19:19:53 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:53 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e" returned: 0 in 0.626s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:53 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e Apr 24 19:19:53 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:54 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.info" returned: 0 in 0.528s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:54 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.info is being set with open permissions: ugo+rw Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:54 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.info Apr 24 19:19:54 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:54 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-1c320a6f-2e0b-417e-8904-3ece6695bcb1" returned: 0 in 0.593s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Lock "cinder-quobyte-1c320a6f-2e0b-417e-8904-3ece6695bcb1" released by "delete_volume" :: held 1.880s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Created reservations ['ce4b7343-abe7-492e-85ae-5cae7b4ca910', 'cad9e11b-1308-4754-b2a0-af84e09a1eb9', '8b899e47-4287-45e9-ba63-9d8f40091855', '591a1e2f-dceb-40ed-811d-3b8334420572'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:54 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:54 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:54 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.786a0f93-6c47-45a3-8715-3c15e79cb67e" returned: 0 in 0.591s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d879af-e9f4-4add-a99e-a77972e66b07 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 -F qcow2 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:54 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d879af-e9f4-4add-a99e-a77972e66b07 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 -F qcow2 Apr 24 19:19:54 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:54 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.info" returned: 0 in 0.600s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.066s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-519056209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f25dc12-3bf0-47a8-901c-6747d4051535,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da85431fb84e44ae85b1a61e9d6ef1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:52Z,use_quota=True,user_id='fc054f53d2864457a7ed9992f95e04f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Creating volume 8f25dc12-3bf0-47a8-901c-6747d4051535 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:54 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:54 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-5b756e18-6f31-44b1-847c-d692b46a68b4 tempest-SnapshotDependencyTests-2085942436 None] Create snapshot completed successfully Apr 24 19:19:54 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535 1073741824 Apr 24 19:19:54 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:54 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.588s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:54 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Deleted volume successfully. Apr 24 19:19:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4c305893-82fb-4922-ad38-bf2af8e11d0c tempest-VolumesImageMetadata-865239530 None] Lock "cinder-1c320a6f-2e0b-417e-8904-3ece6695bcb1-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:55 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d879af-e9f4-4add-a99e-a77972e66b07 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 -F qcow2" returned: 0 in 0.798s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-786a0f93-6c47-45a3-8715-3c15e79cb67e" released by "_delete_snapshot" :: held 5.598s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-c4d879af-e9f4-4add-a99e-a77972e66b07" released by "delete_snapshot" :: held 5.626s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Created reservations ['8844ce34-7e63-46fb-9e61-9ddc485a50f5', 'ab371bfb-0cd5-4bee-8a13-caf61f13bb21', '31135a2c-bc4d-49c1-b8f4-58e94b1a74ef', 'fff62c12-e9b4-4f71-a5f2-d3b076897a30'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:55 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Delete snapshot completed successfully. Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-786a0f93-6c47-45a3-8715-3c15e79cb67e-delete_snapshot" released by "delete_snapshot" :: held 5.895s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-7c0c4e20-8f2b-435e-89fd-d895930d9ca7-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:55 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535 1073741824" returned: 0 in 0.925s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-7c0c4e20-8f2b-435e-89fd-d895930d9ca7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-quobyte-c4d879af-e9f4-4add-a99e-a77972e66b07" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-c4d879af-e9f4-4add-a99e-a77972e66b07" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-quobyte-7c0c4e20-8f2b-435e-89fd-d895930d9ca7" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-7c0c4e20-8f2b-435e-89fd-d895930d9ca7" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Deleting offline snapshot 7c0c4e20-8f2b-435e-89fd-d895930d9ca7 of volume c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:19:55 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535 Apr 24 19:19:55 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] snapshot_file for this snap is: volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[274596dc-4221-4fc5-9712-4d3a1b4d146e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:55 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 Apr 24 19:19:55 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:56 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535" returned: 0 in 0.813s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73da7793-1f52-4685-b3e6-2b96687eb660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f25dc12-3bf0-47a8-901c-6747d4051535', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0400ac85-613a-4a36-9fb0-88a86b17d200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:56 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Volume volume-8f25dc12-3bf0-47a8-901c-6747d4051535 (8f25dc12-3bf0-47a8-901c-6747d4051535): created successfully Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0400ac85-613a-4a36-9fb0-88a86b17d200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Flow 'volume_create_manager' (b299d932-929a-45ed-8287-790fa73979af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:56 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-499e7839-c89a-438b-86de-424fc2ce15b4 tempest-VolumesListTestJSON-328564144 None] Created volume successfully. Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Flow 'volume_create_manager' (ec35d9b7-7143-49f5-a703-01dbe728603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4972ea-10a2-4921-b006-135673b1631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:56 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7" returned: 0 in 0.895s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d879af-e9f4-4add-a99e-a77972e66b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4972ea-10a2-4921-b006-135673b1631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a428df4-5094-47e1-8382-96d8bccfe0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='842d705b946347e3889c03ea15226d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:57Z,use_quota=True,user_id='2080ac09c1374151873ddde7eb3c8944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0f9bec-7acb-447b-acf7-6b8ca6a26fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0f9bec-7acb-447b-acf7-6b8ca6a26fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa656a27-e2a2-43a2-b718-e74ceeed5eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa656a27-e2a2-43a2-b718-e74ceeed5eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4a428df4-5094-47e1-8382-96d8bccfe0e3', 'volume_name': 'volume-4a428df4-5094-47e1-8382-96d8bccfe0e3', 'volume_size': 1, 'snapshot_id': '5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cac4da-4029-49d4-b230-f00555ac9467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cac4da-4029-49d4-b230-f00555ac9467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a401e48c-0815-4787-b2e6-be7bf472c9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:56 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Volume 4a428df4-5094-47e1-8382-96d8bccfe0e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4a428df4-5094-47e1-8382-96d8bccfe0e3', 'volume_size': 1, 'snapshot_id': '5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3'} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[08013aab-7aa1-4a69-8ca7-dd3659d4b547]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "cinder-quobyte-5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3-4a428df4-5094-47e1-8382-96d8bccfe0e3" by "_create_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3-4a428df4-5094-47e1-8382-96d8bccfe0e3" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Creating volume 4a428df4-5094-47e1-8382-96d8bccfe0e3 from snapshot 5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 {{(pid=82057) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "cinder-quobyte-4a428df4-5094-47e1-8382-96d8bccfe0e3" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-4a428df4-5094-47e1-8382-96d8bccfe0e3" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] snapshot: 5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3, volume: 4a428df4-5094-47e1-8382-96d8bccfe0e3, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:19:56 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:56 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c763dc6-35bd-4500-967d-bd05a06f6c10]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:57 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 Apr 24 19:19:57 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:57 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07" returned: 0 in 0.789s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:57 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 Apr 24 19:19:57 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:57 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=116,cinder:INSERT=47,cinder:UPDATE=140,cinder:DELETE=18 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:19:57 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:57 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:19:57 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Flow 'volume_create_manager' (3c717f9a-0a36-42e2-810e-0871aec47876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a06f60c-6b9e-41fa-9cb8-010cf3cdd23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3" returned: 0 in 1.017s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b9dd2-6881-420f-8cc1-183f0a167af6]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a06f60c-6b9e-41fa-9cb8-010cf3cdd23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-813543151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7693e7-1edb-4512-aad6-8ec6c993de76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da85431fb84e44ae85b1a61e9d6ef1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:58Z,use_quota=True,user_id='fc054f53d2864457a7ed9992f95e04f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a31497-4fc6-4c07-9393-5841065918e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a31497-4fc6-4c07-9393-5841065918e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d653dcf0-2ca6-46c1-8dad-c5830030ef95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d653dcf0-2ca6-46c1-8dad-c5830030ef95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee7693e7-1edb-4512-aad6-8ec6c993de76', 'volume_name': 'volume-ee7693e7-1edb-4512-aad6-8ec6c993de76', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8717ded7-aceb-45d2-be32-befe9d2a3262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8717ded7-aceb-45d2-be32-befe9d2a3262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620eb89d-21c8-49ef-83c6-54f09cafe242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:19:58 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Volume ee7693e7-1edb-4512-aad6-8ec6c993de76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee7693e7-1edb-4512-aad6-8ec6c993de76', 'volume_size': 1} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:58 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 Apr 24 19:19:58 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:58 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7" returned: 0 in 0.789s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:58 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:19:58 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:58 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7 Apr 24 19:19:58 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:58 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" returned: 0 in 0.863s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:19:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:58 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 Apr 24 19:19:58 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:19:59 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.705s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:19:59 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07.7c0c4e20-8f2b-435e-89fd-d895930d9ca7" returned: 0 in 0.741s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-7c0c4e20-8f2b-435e-89fd-d895930d9ca7" released by "_delete_snapshot" :: held 3.438s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-c4d879af-e9f4-4add-a99e-a77972e66b07" released by "delete_snapshot" :: held 3.495s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Created reservations ['0d2e21ab-99de-41a4-861f-58882b9bc796', '5fb4a97a-ef7d-444c-93fb-9f83847edd43', 'cefe7b01-a267-42fa-9fb8-641af97dcb4e', '191e4b32-88c7-414b-952a-cb7766df6672'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:19:59 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Delete snapshot completed successfully. Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-7c0c4e20-8f2b-435e-89fd-d895930d9ca7-delete_snapshot" released by "delete_snapshot" :: held 3.754s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Snapshots deleted, issuing volume delete {{(pid=82057) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-quobyte-c4d879af-e9f4-4add-a99e-a77972e66b07" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-c4d879af-e9f4-4add-a99e-a77972e66b07" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fda7fba-3a3d-461d-bc4b-abfe4afb6757]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:19:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:19:59 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 Apr 24 19:19:59 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:00 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07" returned: 0 in 1.086s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:00 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07 Apr 24 19:20:00 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:01 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c4d879af-e9f4-4add-a99e-a77972e66b07" returned: 0 in 1.330s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-c4d879af-e9f4-4add-a99e-a77972e66b07" released by "delete_volume" :: held 2.517s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:02 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Created reservations ['3d48556a-f1e4-4ca0-aafd-03108a993180', '49bb4390-d87d-42f7-ae90-61676a770e1a', '6300fd87-1b4d-49b4-bfc5-8a4b2fcb2385', 'f39c88ff-1d5d-41b2-84b6-2db23e6f6cf2'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:02 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:02 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:03 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.538s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:03 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:03 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Deleted volume successfully. Apr 24 19:20:03 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26e05362-5d0c-4caa-bf2e-5ff5831c1ca5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-c4d879af-e9f4-4add-a99e-a77972e66b07-delete_volume" released by "delete_volume" :: held 14.288s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:04 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Flow 'volume_create_manager' (39cfcfbc-9662-48f7-b2e7-4704a5f2afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7992daea-c218-48ed-a4b4-bccc47fdd843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7992daea-c218-48ed-a4b4-bccc47fdd843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-387016265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9cfcc6-4e09-423b-ba09-378583c660d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81227b717fde41b481e2d55da293ee07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:05Z,use_quota=True,user_id='be8b42379c594fb1aebbab5ffa7fcca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fcf135-4f78-4a3f-8257-09a0b9dd4c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fcf135-4f78-4a3f-8257-09a0b9dd4c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056eda92-3954-46eb-bd51-56528e5a0353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056eda92-3954-46eb-bd51-56528e5a0353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9cfcc6-4e09-423b-ba09-378583c660d1', 'volume_name': 'volume-0e9cfcc6-4e09-423b-ba09-378583c660d1', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e246c6-8f2a-46ab-8982-d99d2a8ced3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e246c6-8f2a-46ab-8982-d99d2a8ced3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe2e949-f8db-4bd5-af0d-2832d9402699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:05 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Volume 0e9cfcc6-4e09-423b-ba09-378583c660d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9cfcc6-4e09-423b-ba09-378583c660d1', 'volume_size': 1} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Flow 'volume_create_manager' (9b0dd2bb-f195-4939-8540-f12874ac8df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d763af0-c520-4e44-af77-368563e4ae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d763af0-c520-4e44-af77-368563e4ae98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-658089425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9259156b-5dae-40a8-a60d-a3c46a23baaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ed2e5df1ac410080177847ac5bfd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:05Z,use_quota=True,user_id='1c7a17f9a994473d874c8f8f4975978d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8c050f-c2f5-4b1c-b003-dc3583bc059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e8c050f-c2f5-4b1c-b003-dc3583bc059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8c91f1-cfd5-403e-b8a3-63d0bff99f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8c91f1-cfd5-403e-b8a3-63d0bff99f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9259156b-5dae-40a8-a60d-a3c46a23baaf', 'volume_name': 'volume-9259156b-5dae-40a8-a60d-a3c46a23baaf', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c471437-3fe1-41d9-adeb-1f45f1239cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c471437-3fe1-41d9-adeb-1f45f1239cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2057a782-b55b-4d1e-a253-a023d0d0e926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:05 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Volume 9259156b-5dae-40a8-a60d-a3c46a23baaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9259156b-5dae-40a8-a60d-a3c46a23baaf', 'volume_size': 1} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:05 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3" returned: 0 in 6.673s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d1ba26-6c4e-4c61-9fc0-2f47a2ec479c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:05 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 Apr 24 19:20:05 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:06 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" returned: 0 in 0.740s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:20:06 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Converted 1024.00 MB image at 153.42 MB/s Apr 24 19:20:06 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 is being set with open permissions: ugo+rw Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:06 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 Apr 24 19:20:06 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:06 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3" returned: 0 in 0.528s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-4a428df4-5094-47e1-8382-96d8bccfe0e3" released by "_copy_volume_from_snapshot" :: held 9.964s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3-4a428df4-5094-47e1-8382-96d8bccfe0e3" released by "_create_volume_from_snapshot" :: held 10.015s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.047s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.798s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-813543151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7693e7-1edb-4512-aad6-8ec6c993de76,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da85431fb84e44ae85b1a61e9d6ef1f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:19:58Z,use_quota=True,user_id='fc054f53d2864457a7ed9992f95e04f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Creating volume ee7693e7-1edb-4512-aad6-8ec6c993de76 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:06 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:06 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76 1073741824 Apr 24 19:20:06 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a401e48c-0815-4787-b2e6-be7bf472c9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a428df4-5094-47e1-8382-96d8bccfe0e3', 'volume_size': 1, 'snapshot_id': '5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391c20f3-98b1-4b43-a4c7-aa3060ebfa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:06 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Volume volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 (4a428df4-5094-47e1-8382-96d8bccfe0e3): created successfully Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391c20f3-98b1-4b43-a4c7-aa3060ebfa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Flow 'volume_create_manager' (ec35d9b7-7143-49f5-a703-01dbe728603b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:06 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1884dca1-bc59-41ac-b419-101ace93cfd7 tempest-SnapshotDependencyTests-2085942436 None] Created volume successfully. Apr 24 19:20:07 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76 1073741824" returned: 0 in 0.690s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:07 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76 Apr 24 19:20:07 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:08 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76" returned: 0 in 0.510s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.950s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-387016265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9cfcc6-4e09-423b-ba09-378583c660d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81227b717fde41b481e2d55da293ee07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:05Z,use_quota=True,user_id='be8b42379c594fb1aebbab5ffa7fcca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Creating volume 0e9cfcc6-4e09-423b-ba09-378583c660d1 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:08 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620eb89d-21c8-49ef-83c6-54f09cafe242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee7693e7-1edb-4512-aad6-8ec6c993de76', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c8dc46-46c7-47a8-9366-ad16900fe86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "cinder-5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:08 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1 1073741824 Apr 24 19:20:08 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:08 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Volume volume-ee7693e7-1edb-4512-aad6-8ec6c993de76 (ee7693e7-1edb-4512-aad6-8ec6c993de76): created successfully Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c8dc46-46c7-47a8-9366-ad16900fe86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Flow 'volume_create_manager' (3c717f9a-0a36-42e2-810e-0871aec47876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "cinder-quobyte-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:08 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9eb86210-2606-4727-87a6-60703cba6bfc tempest-VolumesListTestJSON-328564144 None] Created volume successfully. Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "cinder-quobyte-5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Deleting offline snapshot 5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 of volume 4d2d7ead-e073-4eb3-86b7-4de80fd4c842 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] snapshot_file for this snap is: volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b988242-3591-4783-a056-bde83ecb05fc]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:08 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 Apr 24 19:20:08 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:08 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1 1073741824" returned: 0 in 0.719s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:08 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3" returned: 0 in 0.611s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:20:08 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1 Apr 24 19:20:08 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe83b35-a9bd-43af-ad2a-21b84abdaab2]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:09 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 Apr 24 19:20:09 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:09 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1" returned: 0 in 0.543s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.038s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-658089425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9259156b-5dae-40a8-a60d-a3c46a23baaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ed2e5df1ac410080177847ac5bfd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:05Z,use_quota=True,user_id='1c7a17f9a994473d874c8f8f4975978d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Creating volume 9259156b-5dae-40a8-a60d-a3c46a23baaf {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:09 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:09 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf 1073741824 Apr 24 19:20:09 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe2e949-f8db-4bd5-af0d-2832d9402699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9cfcc6-4e09-423b-ba09-378583c660d1', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a86c84-bfef-499b-84d6-c221de4c9e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:09 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Volume volume-0e9cfcc6-4e09-423b-ba09-378583c660d1 (0e9cfcc6-4e09-423b-ba09-378583c660d1): created successfully Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a86c84-bfef-499b-84d6-c221de4c9e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Flow 'volume_create_manager' (39cfcfbc-9662-48f7-b2e7-4704a5f2afc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:09 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-55f0af84-3cf2-4141-a9a3-7b3042f58e11 tempest-AbsoluteLimitsTests-991574819 None] Created volume successfully. Apr 24 19:20:09 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" returned: 0 in 0.639s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:09 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 Apr 24 19:20:09 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Acquiring lock "cinder-0e9cfcc6-4e09-423b-ba09-378583c660d1-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Lock "cinder-0e9cfcc6-4e09-423b-ba09-378583c660d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:10 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf 1073741824" returned: 0 in 0.864s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Acquiring lock "cinder-quobyte-0e9cfcc6-4e09-423b-ba09-378583c660d1" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Lock "cinder-quobyte-0e9cfcc6-4e09-423b-ba09-378583c660d1" acquired by "delete_volume" :: waited 0.028s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:10 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f4c0ad-7a8b-4378-b361-87eda33ec173]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:10 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3" returned: 0 in 0.855s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:10 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf Apr 24 19:20:10 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:10 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3 Apr 24 19:20:10 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:10 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1 Apr 24 19:20:10 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:11 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf" returned: 0 in 0.606s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:11 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2057a782-b55b-4d1e-a253-a023d0d0e926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9259156b-5dae-40a8-a60d-a3c46a23baaf', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3fdcf3-d613-48ca-b763-b43a66a79483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842.5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3" returned: 0 in 0.600s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:11 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Volume volume-9259156b-5dae-40a8-a60d-a3c46a23baaf (9259156b-5dae-40a8-a60d-a3c46a23baaf): created successfully Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3fdcf3-d613-48ca-b763-b43a66a79483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Flow 'volume_create_manager' (9b0dd2bb-f195-4939-8540-f12874ac8df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:11 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1" returned: 0 in 0.696s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3" released by "_delete_snapshot" :: held 2.857s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" released by "delete_snapshot" :: held 2.909s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:11 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1 Apr 24 19:20:11 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-bd56611f-a5bc-4669-8d40-00bda5787abe tempest-VolumesDeleteCascade-233682129 None] Created volume successfully. Apr 24 19:20:11 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Created reservations ['1651b97e-9ebd-457d-9e42-e1ef532173c4', '3aafd54d-8af7-4c75-b1d9-d4451e6fa2fe', 'e4ce51a0-2f96-4d88-8333-8f9f45aedf97', 'bbf43ae1-4f6f-41cf-b4b2-3b1766788fbb'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:11 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Delete snapshot completed successfully. Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e4e62432-5506-470f-ba3c-d1eac079183b tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-5b8d2fc1-c45c-43ee-8e91-f2e81a15e3c3-delete_snapshot" released by "delete_snapshot" :: held 3.145s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "cinder-4d2d7ead-e073-4eb3-86b7-4de80fd4c842-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-4d2d7ead-e073-4eb3-86b7-4de80fd4c842-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "cinder-quobyte-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" acquired by "delete_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7ed79e-6ad6-40a4-9cbc-4528906cfb05]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:11 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 Apr 24 19:20:11 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:11 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-0e9cfcc6-4e09-423b-ba09-378583c660d1" returned: 0 in 0.744s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Lock "cinder-quobyte-0e9cfcc6-4e09-423b-ba09-378583c660d1" released by "delete_volume" :: held 1.535s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Acquiring lock "cinder-ee7693e7-1edb-4512-aad6-8ec6c993de76-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] Creating offline snapshot a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 of volume 9259156b-5dae-40a8-a60d-a3c46a23baaf {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Lock "cinder-ee7693e7-1edb-4512-aad6-8ec6c993de76-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f393c0ed-b709-4a30-b218-a705534ec07c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Created reservations ['7c1c9d63-f5db-4529-b93d-5e7e6ff2dd59', '935ea1ab-ea60-4724-ba8d-a47a187985b5', '26ece780-04dc-4498-aab7-649f2466576a', 'd5aef8f9-7ad8-4fe3-9dcf-a9ada25385bc'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Acquiring lock "cinder-quobyte-ee7693e7-1edb-4512-aad6-8ec6c993de76" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Lock "cinder-quobyte-ee7693e7-1edb-4512-aad6-8ec6c993de76" acquired by "delete_volume" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:12 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf Apr 24 19:20:12 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dbe8d2-7a88-41e5-ae58-5ddb9f0357b3]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:12 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:12 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:12 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76 Apr 24 19:20:12 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:12 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" returned: 0 in 0.793s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:12 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842 Apr 24 19:20:12 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:12 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf" returned: 0 in 0.742s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:12 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 1G Apr 24 19:20:12 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:12 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.672s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:12 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Deleted volume successfully. Apr 24 19:20:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0c4daf4f-94e6-4b26-a111-be7669d7dc64 tempest-AbsoluteLimitsTests-991574819 None] Lock "cinder-0e9cfcc6-4e09-423b-ba09-378583c660d1-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:13 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76" returned: 0 in 0.797s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:13 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:13 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76 Apr 24 19:20:13 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" returned: 0 in 0.656s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-4d2d7ead-e073-4eb3-86b7-4de80fd4c842" released by "delete_volume" :: held 1.546s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Created reservations ['6920d288-0c56-455f-9067-3682fee844c4', '673d0649-0406-4e54-8ba6-19202b7cd6d2', '979d5543-aac1-41e6-9f7e-5c14c1edf777', '9e91c1f0-0a2f-4189-9fff-5f237a67eb23'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:13 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:13 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:13 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ee7693e7-1edb-4512-aad6-8ec6c993de76" returned: 0 in 0.677s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Lock "cinder-quobyte-ee7693e7-1edb-4512-aad6-8ec6c993de76" released by "delete_volume" :: held 1.545s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:13 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 1G" returned: 0 in 0.949s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9259156b-5dae-40a8-a60d-a3c46a23baaf -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Created reservations ['f8dead73-6d08-477d-a5e6-f600e540fdff', 'f9f039e1-d7c4-43eb-940a-51a90f54f847', 'bee92780-c2d8-4ee6-96a7-cbfe515f706d', '0246c7a7-65e7-4763-94aa-8cd73e7dbcf9'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:13 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9259156b-5dae-40a8-a60d-a3c46a23baaf -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 Apr 24 19:20:13 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "cinder-4a428df4-5094-47e1-8382-96d8bccfe0e3-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:13 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:13 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-4a428df4-5094-47e1-8382-96d8bccfe0e3-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "cinder-quobyte-4a428df4-5094-47e1-8382-96d8bccfe0e3" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-4a428df4-5094-47e1-8382-96d8bccfe0e3" acquired by "delete_volume" :: waited 0.048s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eef60f-ce15-4d10-ae49-388efa34d420]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:14 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.875s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:14 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Deleted volume successfully. Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-618bc554-e053-4f4b-b0bf-c0e4b5ae7052 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-4d2d7ead-e073-4eb3-86b7-4de80fd4c842-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:14 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 Apr 24 19:20:14 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Acquiring lock "cinder-8f25dc12-3bf0-47a8-901c-6747d4051535-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Lock "cinder-8f25dc12-3bf0-47a8-901c-6747d4051535-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Acquiring lock "cinder-quobyte-8f25dc12-3bf0-47a8-901c-6747d4051535" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Lock "cinder-quobyte-8f25dc12-3bf0-47a8-901c-6747d4051535" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b504d6-edb9-4a8e-b49b-5b0d7a473969]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:14 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535 Apr 24 19:20:14 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:14 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9259156b-5dae-40a8-a60d-a3c46a23baaf -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0" returned: 0 in 0.967s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:14 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 is being set with open permissions: ugo+rw Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:14 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 Apr 24 19:20:14 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:14 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.973s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:14 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Deleted volume successfully. Apr 24 19:20:14 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8314a67e-cc4d-4422-abfd-d91ad38eea63 tempest-VolumesListTestJSON-328564144 None] Lock "cinder-ee7693e7-1edb-4512-aad6-8ec6c993de76-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:15 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3" returned: 0 in 0.903s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:15 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3 Apr 24 19:20:15 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:15 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535" returned: 0 in 0.889s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:15 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0" returned: 0 in 0.713s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:15 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535 Apr 24 19:20:15 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:15 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.info Apr 24 19:20:15 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:15 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4a428df4-5094-47e1-8382-96d8bccfe0e3" returned: 0 in 0.784s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-quobyte-4a428df4-5094-47e1-8382-96d8bccfe0e3" released by "delete_volume" :: held 1.751s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Created reservations ['25da9de8-07e9-4a35-a1cd-c8552ead579d', 'efe19f0a-a28d-4b29-9df6-8349eedcb0d9', 'dd36e120-b553-4291-9ee8-002fd1fa1a86', '3e8d3ff9-4197-4261-bd83-cdfe345aa243'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:16 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:16 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:16 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.info" returned: 0 in 0.818s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:16 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.info is being set with open permissions: ugo+rw Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:16 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-8f25dc12-3bf0-47a8-901c-6747d4051535" returned: 0 in 0.880s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:16 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.info Apr 24 19:20:16 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Lock "cinder-quobyte-8f25dc12-3bf0-47a8-901c-6747d4051535" released by "delete_volume" :: held 1.824s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Created reservations ['de2065ea-b84b-4c2f-bf50-6c530ee43cb6', '0c54c510-78ba-49b0-a963-a66bcdb8bf33', '4ba82811-4dad-4233-afdb-472ce67a1851', 'bdaac251-5756-4119-a08e-248510fd508f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:16 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:16 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:16 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.825s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:16 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Deleted volume successfully. Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9339b9e2-99f2-44c4-b668-0980ae0a4413 tempest-SnapshotDependencyTests-2085942436 None] Lock "cinder-4a428df4-5094-47e1-8382-96d8bccfe0e3-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Acquiring lock "cinder-5b48d001-b25d-4f13-8e72-97bcb40e52c0-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:16 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Lock "cinder-5b48d001-b25d-4f13-8e72-97bcb40e52c0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Acquiring lock "cinder-quobyte-5b48d001-b25d-4f13-8e72-97bcb40e52c0" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Lock "cinder-quobyte-5b48d001-b25d-4f13-8e72-97bcb40e52c0" acquired by "delete_volume" :: waited 0.045s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:17 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1782f6-d023-46a4-8468-67c8f748a3c3]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:17 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.info" returned: 0 in 0.821s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.181s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:17 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-08b301f5-78e5-4146-9d19-c057c4b23c7e tempest-VolumesDeleteCascade-233682129 None] Create snapshot completed successfully Apr 24 19:20:17 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0 Apr 24 19:20:17 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:17 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.804s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:17 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:17 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Deleted volume successfully. Apr 24 19:20:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f7893c0a-cb5e-406f-815e-cd20bc13a36c tempest-VolumesListTestJSON-328564144 None] Lock "cinder-8f25dc12-3bf0-47a8-901c-6747d4051535-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:17 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0" returned: 0 in 0.790s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:17 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0 Apr 24 19:20:17 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Flow 'volume_create_manager' (d3799219-74eb-4e0f-a0e5-e430a537dc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e534112-cc04-46c1-a7fa-552c64236af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e534112-cc04-46c1-a7fa-552c64236af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-990734904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89dc71aa-e21e-4956-b4fb-71d5ee0e4e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf11502b52ea4477ba9c465e3270c950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:18Z,use_quota=True,user_id='5adc6b8e6084481aa4ea26693efbe1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82949628-d3aa-422c-a269-cd328003ff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82949628-d3aa-422c-a269-cd328003ff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fcd5b8-7cbc-440d-84b3-6a5d13cff79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fcd5b8-7cbc-440d-84b3-6a5d13cff79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89dc71aa-e21e-4956-b4fb-71d5ee0e4e54', 'volume_name': 'volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a39a70-db27-4f63-a2c6-a1d2e34004e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a39a70-db27-4f63-a2c6-a1d2e34004e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44776bae-5d46-46d6-92a6-7e72bc8ab5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:18 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Volume 89dc71aa-e21e-4956-b4fb-71d5ee0e4e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54', 'volume_size': 1} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-990734904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89dc71aa-e21e-4956-b4fb-71d5ee0e4e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf11502b52ea4477ba9c465e3270c950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:18Z,use_quota=True,user_id='5adc6b8e6084481aa4ea26693efbe1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Creating volume 89dc71aa-e21e-4956-b4fb-71d5ee0e4e54 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:18 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:18 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54 1073741824 Apr 24 19:20:18 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:18 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5b48d001-b25d-4f13-8e72-97bcb40e52c0" returned: 0 in 0.660s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Lock "cinder-quobyte-5b48d001-b25d-4f13-8e72-97bcb40e52c0" released by "delete_volume" :: held 1.508s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Created reservations ['e5eb60d6-1b0a-48a2-8a4c-a8f7168c854b', '9e9b0048-58d3-4851-bacf-a8f671797f3b', 'e898ff41-41c0-46a4-b4b2-743ddb172c93', '86e53b57-a7bf-4a8d-80e5-08a89b4bc7a1'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:18 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:18 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Flow 'volume_create_manager' (9797562f-3289-40e2-8c59-16144d34a0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f77640-6a8e-4cee-9a1e-b36b7a461df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f77640-6a8e-4cee-9a1e-b36b7a461df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-873576795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=744d4dae-a13f-417e-b2ae-e2a7e370624e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ed2e5df1ac410080177847ac5bfd08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a0d4b81f-9254-40bd-bc8e-0c43b3a842b0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:19Z,use_quota=True,user_id='1c7a17f9a994473d874c8f8f4975978d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1458fd-467a-4471-8ead-acd4bf2cffcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1458fd-467a-4471-8ead-acd4bf2cffcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100895f3-2036-4a93-bd62-46193ee61153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100895f3-2036-4a93-bd62-46193ee61153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '744d4dae-a13f-417e-b2ae-e2a7e370624e', 'volume_name': 'volume-744d4dae-a13f-417e-b2ae-e2a7e370624e', 'volume_size': 1, 'snapshot_id': 'a0d4b81f-9254-40bd-bc8e-0c43b3a842b0'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01b9d24-b07e-4d00-86ab-1a5024b7c889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01b9d24-b07e-4d00-86ab-1a5024b7c889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b324cec3-24a9-4c3d-8db1-7455fd4a3209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:19 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Volume 744d4dae-a13f-417e-b2ae-e2a7e370624e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-744d4dae-a13f-417e-b2ae-e2a7e370624e', 'volume_size': 1, 'snapshot_id': 'a0d4b81f-9254-40bd-bc8e-0c43b3a842b0'} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:19 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54 1073741824" returned: 0 in 1.027s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:19 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54 Apr 24 19:20:19 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:19 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.620s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:19 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Deleted volume successfully. Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-59853b3c-7221-4ad5-8e65-eab5921a3e41 tempest-VolumesListTestJSON-328564144 None] Lock "cinder-5b48d001-b25d-4f13-8e72-97bcb40e52c0-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:19 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54" returned: 0 in 0.614s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.794s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-quobyte-a0d4b81f-9254-40bd-bc8e-0c43b3a842b0-744d4dae-a13f-417e-b2ae-e2a7e370624e" by "_create_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-a0d4b81f-9254-40bd-bc8e-0c43b3a842b0-744d4dae-a13f-417e-b2ae-e2a7e370624e" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Creating volume 744d4dae-a13f-417e-b2ae-e2a7e370624e from snapshot a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 {{(pid=82057) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-quobyte-744d4dae-a13f-417e-b2ae-e2a7e370624e" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44776bae-5d46-46d6-92a6-7e72bc8ab5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c27e5dc-6576-4319-aa66-3092ef7d70b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:19 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Volume volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54 (89dc71aa-e21e-4956-b4fb-71d5ee0e4e54): created successfully Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c27e5dc-6576-4319-aa66-3092ef7d70b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Flow 'volume_create_manager' (d3799219-74eb-4e0f-a0e5-e430a537dc2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:20 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-aa6b4bbd-a1c9-4e80-8828-2f2ab7d78a9c tempest-VolumesMetadataTest-1535076003 None] Created volume successfully. Apr 24 19:20:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-744d4dae-a13f-417e-b2ae-e2a7e370624e" acquired by "_copy_volume_from_snapshot" :: waited 0.060s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] snapshot: a0d4b81f-9254-40bd-bc8e-0c43b3a842b0, volume: 744d4dae-a13f-417e-b2ae-e2a7e370624e, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:20:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:20 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0022e7-8dbd-4555-a196-1605d98a2b7a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:20 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 Apr 24 19:20:20 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:21 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0" returned: 0 in 0.972s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9259156b-5dae-40a8-a60d-a3c46a23baaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[76426e3b-a536-4ce6-b5e2-0c0e7eacbf9a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Acquiring lock "cinder-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Lock "cinder-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:21 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf Apr 24 19:20:21 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Acquiring lock "cinder-quobyte-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Lock "cinder-quobyte-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54" acquired by "delete_volume" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0d478e-37ee-4e52-ae6f-8caa969506ac]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:21 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54 Apr 24 19:20:21 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:22 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf" returned: 0 in 1.133s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:22 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:20:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:22 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e Apr 24 19:20:22 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:22 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54" returned: 0 in 0.985s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:22 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54 Apr 24 19:20:22 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:23 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54" returned: 0 in 0.622s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Lock "cinder-quobyte-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54" released by "delete_volume" :: held 1.683s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:23 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Created reservations ['088c90cf-2959-4f9c-a703-d750c6b682ef', 'bef9ffa4-63d5-4246-bf3e-5978421ad5cc', '04727dae-94a0-412e-87a8-dbd157bf53d5', 'af454087-c7ff-4e2d-b62e-6c0a50069642'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:23 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:23 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:23 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:23 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:25 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.650s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:25 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Deleted volume successfully. Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-18b03bc9-3a11-4218-868f-b54a9db53208 tempest-VolumesMetadataTest-1535076003 None] Lock "cinder-89dc71aa-e21e-4956-b4fb-71d5ee0e4e54-delete_volume" released by "delete_volume" :: held 4.054s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:UPDATE=139,cinder:SELECT=121,cinder:DELETE=11,cinder:INSERT=38 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Flow 'volume_create_manager' (b64f2e20-b547-43fa-9317-4bdfba3b9e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6deb714c-3a26-4968-a49c-edec1df97580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6deb714c-3a26-4968-a49c-edec1df97580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1942984700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da7f9d6-3270-4159-9a7a-13895da6c39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee753c5907b8409f96adeb5ac2d8ce76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:26Z,use_quota=True,user_id='032053308c7448bb9ca1bb1e2b1299fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd41ea0-2d8f-49e5-8939-34d330803e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd41ea0-2d8f-49e5-8939-34d330803e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23d2f06-2d65-43a4-8e2c-4daa87a05f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23d2f06-2d65-43a4-8e2c-4daa87a05f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da7f9d6-3270-4159-9a7a-13895da6c39b', 'volume_name': 'volume-6da7f9d6-3270-4159-9a7a-13895da6c39b', 'volume_size': 2}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ff53e7-31b4-4986-9946-c436508cf53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ff53e7-31b4-4986-9946-c436508cf53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2cad1e-9699-4557-b06e-c7ad0ff86ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:26 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Volume 6da7f9d6-3270-4159-9a7a-13895da6c39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da7f9d6-3270-4159-9a7a-13895da6c39b', 'volume_size': 2} Apr 24 19:20:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:29 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e" returned: 0 in 7.227s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:29 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f3d0f6-6d73-4437-b098-46b9a4fb51c6]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:29 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf Apr 24 19:20:29 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:30 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf" returned: 0 in 0.895s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:20:30 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Converted 1024.00 MB image at 141.64 MB/s Apr 24 19:20:30 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e is being set with open permissions: ugo+rw Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:30 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e Apr 24 19:20:30 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:30 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e" returned: 0 in 0.585s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-744d4dae-a13f-417e-b2ae-e2a7e370624e" released by "_copy_volume_from_snapshot" :: held 10.965s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-a0d4b81f-9254-40bd-bc8e-0c43b3a842b0-744d4dae-a13f-417e-b2ae-e2a7e370624e" released by "_create_volume_from_snapshot" :: held 11.056s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.090s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.941s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1942984700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da7f9d6-3270-4159-9a7a-13895da6c39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee753c5907b8409f96adeb5ac2d8ce76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:26Z,use_quota=True,user_id='032053308c7448bb9ca1bb1e2b1299fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Creating volume 6da7f9d6-3270-4159-9a7a-13895da6c39b {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:31 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b 2147483648 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:31 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b 2147483648 Apr 24 19:20:31 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b324cec3-24a9-4c3d-8db1-7455fd4a3209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744d4dae-a13f-417e-b2ae-e2a7e370624e', 'volume_size': 1, 'snapshot_id': 'a0d4b81f-9254-40bd-bc8e-0c43b3a842b0'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5882a5-d929-4399-b5b1-ac8bb2bc13bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:31 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Volume volume-744d4dae-a13f-417e-b2ae-e2a7e370624e (744d4dae-a13f-417e-b2ae-e2a7e370624e): created successfully Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5882a5-d929-4399-b5b1-ac8bb2bc13bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Flow 'volume_create_manager' (9797562f-3289-40e2-8c59-16144d34a0ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:31 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-47f0a9e7-a999-45cb-89d4-aa460a03d37c tempest-VolumesDeleteCascade-233682129 None] Created volume successfully. Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-9259156b-5dae-40a8-a60d-a3c46a23baaf-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-9259156b-5dae-40a8-a60d-a3c46a23baaf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Performing cascade delete. {{(pid=82057) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-a0d4b81f-9254-40bd-bc8e-0c43b3a842b0-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-a0d4b81f-9254-40bd-bc8e-0c43b3a842b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-quobyte-9259156b-5dae-40a8-a60d-a3c46a23baaf" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-9259156b-5dae-40a8-a60d-a3c46a23baaf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-quobyte-a0d4b81f-9254-40bd-bc8e-0c43b3a842b0" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-a0d4b81f-9254-40bd-bc8e-0c43b3a842b0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Deleting offline snapshot a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 of volume 9259156b-5dae-40a8-a60d-a3c46a23baaf {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:20:31 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] snapshot_file for this snap is: volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96f83f1-423d-4a39-a966-74e6fbf02f11]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:32 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b 2147483648" returned: 0 in 1.091s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:32 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 Apr 24 19:20:32 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:32 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b Apr 24 19:20:32 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:32 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b" returned: 0 in 0.623s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:32 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0" returned: 0 in 0.770s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9259156b-5dae-40a8-a60d-a3c46a23baaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2cad1e-9699-4557-b06e-c7ad0ff86ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da7f9d6-3270-4159-9a7a-13895da6c39b', 'volume_size': 2}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c354fa4-be3f-467f-95fb-8b53a6d05f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[d808345d-11a0-4bad-bd69-0525b7f17b94]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:32 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Volume volume-6da7f9d6-3270-4159-9a7a-13895da6c39b (6da7f9d6-3270-4159-9a7a-13895da6c39b): created successfully Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c354fa4-be3f-467f-95fb-8b53a6d05f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Flow 'volume_create_manager' (b64f2e20-b547-43fa-9317-4bdfba3b9e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:32 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6198eca9-07a3-47da-8558-4279155245df tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Created volume successfully. Apr 24 19:20:32 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf Apr 24 19:20:32 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:33 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf" returned: 0 in 0.625s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:33 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 Apr 24 19:20:33 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Creating offline snapshot f1409191-f829-44cc-957b-dc8e24df0c31 of volume 6da7f9d6-3270-4159-9a7a-13895da6c39b {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:20:33 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdec8c8-9e29-4c38-a8d0-9f53636db893]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:33 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b Apr 24 19:20:33 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:34 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0" returned: 0 in 0.722s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:34 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0 Apr 24 19:20:34 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:34 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b" returned: 0 in 0.660s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 2G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:34 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 2G Apr 24 19:20:34 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:34 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf.a0d4b81f-9254-40bd-bc8e-0c43b3a842b0" returned: 0 in 0.533s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-a0d4b81f-9254-40bd-bc8e-0c43b3a842b0" released by "_delete_snapshot" :: held 2.763s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-9259156b-5dae-40a8-a60d-a3c46a23baaf" released by "delete_snapshot" :: held 2.790s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Created reservations ['7dbbacb3-24c0-4fb0-884e-5e88779e06db', '84d56d48-8932-4924-9dec-9ac6ae06e73b', '51795ce2-e772-4b7a-822f-d66f85c93aeb', '5a8556e9-e42f-4b1f-aae2-c57a5ef9bd81'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:34 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Delete snapshot completed successfully. Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-a0d4b81f-9254-40bd-bc8e-0c43b3a842b0-delete_snapshot" released by "delete_snapshot" :: held 2.989s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Snapshots deleted, issuing volume delete {{(pid=82057) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-quobyte-9259156b-5dae-40a8-a60d-a3c46a23baaf" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-9259156b-5dae-40a8-a60d-a3c46a23baaf" acquired by "delete_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4eb8e8-ddc5-4a5e-8dfa-a459a1038995]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:35 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 2G" returned: 0 in 0.741s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da7f9d6-3270-4159-9a7a-13895da6c39b -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:35 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da7f9d6-3270-4159-9a7a-13895da6c39b -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 Apr 24 19:20:35 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:35 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf Apr 24 19:20:35 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:35 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf" returned: 0 in 0.624s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:35 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da7f9d6-3270-4159-9a7a-13895da6c39b -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31" returned: 0 in 0.593s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:35 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 is being set with open permissions: ugo+rw Apr 24 19:20:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:35 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf Apr 24 19:20:35 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:35 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 Apr 24 19:20:35 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:36 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9259156b-5dae-40a8-a60d-a3c46a23baaf" returned: 0 in 0.650s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-9259156b-5dae-40a8-a60d-a3c46a23baaf" released by "delete_volume" :: held 1.350s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:36 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31" returned: 0 in 0.666s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Created reservations ['b6a3f57d-48d4-4702-82ac-82340272f6a3', '5b151cf9-f3e5-42cd-be4e-a57584ff8393', 'b9010939-bb39-4760-bfa4-dec358c764f4', '0c976d5d-90ae-42ec-a30b-fde5784d1abd'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:36 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.info Apr 24 19:20:36 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:36 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:36 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:36 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.info" returned: 0 in 0.607s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:36 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.info is being set with open permissions: ugo+rw Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:36 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.524s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:36 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:36 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.info Apr 24 19:20:36 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:36 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Deleted volume successfully. Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-95ccfa95-2e2b-4bb3-b22d-37e2085b0be5 tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-9259156b-5dae-40a8-a60d-a3c46a23baaf-delete_volume" released by "delete_volume" :: held 5.239s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-744d4dae-a13f-417e-b2ae-e2a7e370624e-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-744d4dae-a13f-417e-b2ae-e2a7e370624e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "cinder-quobyte-744d4dae-a13f-417e-b2ae-e2a7e370624e" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-744d4dae-a13f-417e-b2ae-e2a7e370624e" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[653259bb-40e5-496f-b744-3f2a97f0dcf3]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:37 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.info" returned: 0 in 0.589s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.004s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:37 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-503489df-8145-415f-82d8-a81aa2b146aa tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Create snapshot completed successfully Apr 24 19:20:37 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e Apr 24 19:20:37 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Acquiring lock "cinder-f1409191-f829-44cc-957b-dc8e24df0c31-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "cinder-f1409191-f829-44cc-957b-dc8e24df0c31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Acquiring lock "cinder-quobyte-6da7f9d6-3270-4159-9a7a-13895da6c39b" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "cinder-quobyte-6da7f9d6-3270-4159-9a7a-13895da6c39b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Acquiring lock "cinder-quobyte-f1409191-f829-44cc-957b-dc8e24df0c31" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "cinder-quobyte-f1409191-f829-44cc-957b-dc8e24df0c31" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Deleting offline snapshot f1409191-f829-44cc-957b-dc8e24df0c31 of volume 6da7f9d6-3270-4159-9a7a-13895da6c39b {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] snapshot_file for this snap is: volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee4e736-62ea-4f76-b7d7-d7a271fa6960]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:38 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 Apr 24 19:20:38 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:38 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e" returned: 0 in 0.755s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:38 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e Apr 24 19:20:38 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:38 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31" returned: 0 in 0.685s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da7f9d6-3270-4159-9a7a-13895da6c39b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:20:38 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8aaec8-7940-477b-811d-464a259f55c8]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:38 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b Apr 24 19:20:38 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:38 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-744d4dae-a13f-417e-b2ae-e2a7e370624e" returned: 0 in 0.554s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-quobyte-744d4dae-a13f-417e-b2ae-e2a7e370624e" released by "delete_volume" :: held 1.368s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:38 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Created reservations ['6c8d85fa-5e9f-470a-bc23-1414981db63c', '6791743e-a5f3-464f-9904-8972b23a2728', '716e2f83-9af9-46b9-a3cd-dc9e79c29341', '76a5990c-9db7-4225-b466-258fba90f0cd'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:39 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:39 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:39 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b" returned: 0 in 0.626s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:39 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 Apr 24 19:20:39 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:39 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.595s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:39 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Deleted volume successfully. Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9a95e07d-710b-42e7-ae06-3b2f66e2494e tempest-VolumesDeleteCascade-233682129 None] Lock "cinder-744d4dae-a13f-417e-b2ae-e2a7e370624e-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:39 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31" returned: 0 in 0.641s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:40 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31 Apr 24 19:20:40 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:40 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b.f1409191-f829-44cc-957b-dc8e24df0c31" returned: 0 in 0.573s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "cinder-quobyte-f1409191-f829-44cc-957b-dc8e24df0c31" released by "_delete_snapshot" :: held 2.671s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "cinder-quobyte-6da7f9d6-3270-4159-9a7a-13895da6c39b" released by "delete_snapshot" :: held 2.697s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:40 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Created reservations ['b498be38-5924-458b-a684-20a117ab5be5', '5de03115-86d1-427a-a9dc-9426f0d5657b', '1bbefc05-847b-44b6-bb1f-c44f6565f112', 'c273fac1-8447-42b6-9786-c6813dfca845'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:40 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Delete snapshot completed successfully. Apr 24 19:20:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a985dced-e6b8-4468-9f5e-0069b0fee041 tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "cinder-f1409191-f829-44cc-957b-dc8e24df0c31-delete_snapshot" released by "delete_snapshot" :: held 2.954s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Acquiring lock "cinder-6da7f9d6-3270-4159-9a7a-13895da6c39b-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "cinder-6da7f9d6-3270-4159-9a7a-13895da6c39b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Acquiring lock "cinder-quobyte-6da7f9d6-3270-4159-9a7a-13895da6c39b" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "cinder-quobyte-6da7f9d6-3270-4159-9a7a-13895da6c39b" acquired by "delete_volume" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:41 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[37730fe7-bba2-4c80-bdc1-d03e7c760a29]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:41 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b Apr 24 19:20:41 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:42 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b" returned: 0 in 0.725s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:42 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b Apr 24 19:20:42 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:42 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6da7f9d6-3270-4159-9a7a-13895da6c39b" returned: 0 in 0.746s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:42 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "cinder-quobyte-6da7f9d6-3270-4159-9a7a-13895da6c39b" released by "delete_volume" :: held 1.542s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:42 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Created reservations ['16e12245-a906-4145-9eee-4977467457ba', '5a477efc-af2c-4419-9ae5-c97b302aa0e1', 'eb9e1f8b-6926-4407-8ef5-c6ff0689cd4c', '2aae3074-3317-47ad-9d2b-d89c2c451a95'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:43 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:43 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:43 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.605s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:43 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:43 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Deleted volume successfully. Apr 24 19:20:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e9df2c40-3245-4b61-91c8-db781a01e34b tempest-VolumesSnapshotNegativeTestJSON-448062380 None] Lock "cinder-6da7f9d6-3270-4159-9a7a-13895da6c39b-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:43 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Flow 'volume_create_manager' (a5abab28-367a-45a2-bcf2-13f71fef43d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4e50a5-5cf6-4702-9647-bda014a3eb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4e50a5-5cf6-4702-9647-bda014a3eb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-27314581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92582c0b-6e7e-4963-933e-2656aaeb3f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb5bb7aa981740f2b59190e5845606d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:44Z,use_quota=True,user_id='9e1c2a9fb3c64abbaf31dc63127bcdb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e33b8f8-b24b-48ac-a5b2-d8c01152daa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e33b8f8-b24b-48ac-a5b2-d8c01152daa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff67744-41b5-422b-a4c7-2fa4c68d8ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff67744-41b5-422b-a4c7-2fa4c68d8ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92582c0b-6e7e-4963-933e-2656aaeb3f6f', 'volume_name': 'volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb40a7d-69de-40d9-80d2-e378e27f3f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb40a7d-69de-40d9-80d2-e378e27f3f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4fb1db-2b51-4414-b16c-14945390e516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:44 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Volume 92582c0b-6e7e-4963-933e-2656aaeb3f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f', 'volume_size': 1} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-27314581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92582c0b-6e7e-4963-933e-2656aaeb3f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb5bb7aa981740f2b59190e5845606d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:44Z,use_quota=True,user_id='9e1c2a9fb3c64abbaf31dc63127bcdb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Creating volume 92582c0b-6e7e-4963-933e-2656aaeb3f6f {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:44 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:44 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f 1073741824 Apr 24 19:20:44 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Flow 'volume_create_manager' (ba64dc38-4e99-4ece-97f5-46b97aebe62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701efc56-1176-4144-9585-dfa2dab837ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701efc56-1176-4144-9585-dfa2dab837ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1854841413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09359b91-b397-400d-ad9b-a7cdb46ee06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b6e1670d344cf294725dd9cff55298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:45Z,use_quota=True,user_id='10c0d9bb63964bec9d1cfc88719a614e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c481f66b-04f3-4c99-ae8e-f6044c3f2718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c481f66b-04f3-4c99-ae8e-f6044c3f2718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eaa4e0f-d9a0-4001-a80f-d93dc9d4f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eaa4e0f-d9a0-4001-a80f-d93dc9d4f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09359b91-b397-400d-ad9b-a7cdb46ee06d', 'volume_name': 'volume-09359b91-b397-400d-ad9b-a7cdb46ee06d', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d92407-1968-4afe-8e0e-4fa989d75b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d92407-1968-4afe-8e0e-4fa989d75b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7dabc0-49dc-425c-8883-892d1c7fa2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:44 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Volume 09359b91-b397-400d-ad9b-a7cdb46ee06d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09359b91-b397-400d-ad9b-a7cdb46ee06d', 'volume_size': 1} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:44 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f 1073741824" returned: 0 in 0.856s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:44 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f Apr 24 19:20:44 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:45 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f" returned: 0 in 0.544s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.788s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1854841413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09359b91-b397-400d-ad9b-a7cdb46ee06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b6e1670d344cf294725dd9cff55298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:45Z,use_quota=True,user_id='10c0d9bb63964bec9d1cfc88719a614e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Creating volume 09359b91-b397-400d-ad9b-a7cdb46ee06d {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:45 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4fb1db-2b51-4414-b16c-14945390e516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe0b4c2-46b1-47c8-ab10-3e0dcc4c52ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:45 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d 1073741824 Apr 24 19:20:45 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:45 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Volume volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f (92582c0b-6e7e-4963-933e-2656aaeb3f6f): created successfully Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe0b4c2-46b1-47c8-ab10-3e0dcc4c52ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Flow 'volume_create_manager' (a5abab28-367a-45a2-bcf2-13f71fef43d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:45 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-255d9042-2117-468a-8821-7728e82c9e10 tempest-VolumesActionsTest-999936458 None] Created volume successfully. Apr 24 19:20:46 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d 1073741824" returned: 0 in 0.727s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:46 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d Apr 24 19:20:46 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Flow 'volume_create_manager' (a8ac988d-1048-46d7-ac0e-0e05a8fe9e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497a5198-dab1-4660-b5ee-782b70074bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497a5198-dab1-4660-b5ee-782b70074bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-751735440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ba8eca-9c2d-4d4c-b937-4293cfb80763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74161ac24004c31be3c12a026602192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:46Z,use_quota=True,user_id='14cc4d0ce0c84d828b58d833b1afc22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077fd294-1e44-4b1d-bd29-83c9c1786fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077fd294-1e44-4b1d-bd29-83c9c1786fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5d5d5e-3951-4dd2-bcd0-31239c78aaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5d5d5e-3951-4dd2-bcd0-31239c78aaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ba8eca-9c2d-4d4c-b937-4293cfb80763', 'volume_name': 'volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b1e00a-bd10-4ae5-89df-29aabeefe710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b1e00a-bd10-4ae5-89df-29aabeefe710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f9b76c-3ca8-48e8-b9bd-e16b9794a2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:46 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Volume 27ba8eca-9c2d-4d4c-b937-4293cfb80763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763', 'volume_size': 1} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:46 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d" returned: 0 in 0.594s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-751735440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ba8eca-9c2d-4d4c-b937-4293cfb80763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74161ac24004c31be3c12a026602192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:46Z,use_quota=True,user_id='14cc4d0ce0c84d828b58d833b1afc22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Creating volume 27ba8eca-9c2d-4d4c-b937-4293cfb80763 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:46 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:46 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 1073741824 Apr 24 19:20:46 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7dabc0-49dc-425c-8883-892d1c7fa2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09359b91-b397-400d-ad9b-a7cdb46ee06d', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97376eec-d8da-43e3-a8c4-6e95b081c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:46 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Volume volume-09359b91-b397-400d-ad9b-a7cdb46ee06d (09359b91-b397-400d-ad9b-a7cdb46ee06d): created successfully Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97376eec-d8da-43e3-a8c4-6e95b081c445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Flow 'volume_create_manager' (ba64dc38-4e99-4ece-97f5-46b97aebe62f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:46 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4b65a89e-d6f9-47ec-a2f3-7c751a362b46 tempest-VolumesTransfersV357Test-1390459323 None] Created volume successfully. Apr 24 19:20:47 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 1073741824" returned: 0 in 0.782s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:47 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 Apr 24 19:20:47 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:48 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763" returned: 0 in 0.552s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f9b76c-3ca8-48e8-b9bd-e16b9794a2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372c5604-70ef-4620-badc-faff59c08452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:48 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Volume volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 (27ba8eca-9c2d-4d4c-b937-4293cfb80763): created successfully Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372c5604-70ef-4620-badc-faff59c08452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Flow 'volume_create_manager' (a8ac988d-1048-46d7-ac0e-0e05a8fe9e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:48 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-b30874f0-9dc7-410d-a873-cc3aed62465b tempest-VolumeDependencyTests-238870211 None] Created volume successfully. Apr 24 19:20:48 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-efd5bc0f-a5e2-416e-a00f-50839c990ce8 tempest-VolumesTransfersV357Test-1059051814 None] Transfer volume completed successfully. Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] Creating offline snapshot b7f86714-833f-4cab-9168-43a40022a6ea of volume 27ba8eca-9c2d-4d4c-b937-4293cfb80763 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a20dde-c1f2-4528-92a7-745c9b1923f9]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:48 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 Apr 24 19:20:48 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Acquiring lock "cinder-09359b91-b397-400d-ad9b-a7cdb46ee06d-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Lock "cinder-09359b91-b397-400d-ad9b-a7cdb46ee06d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:49 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763" returned: 0 in 0.650s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:49 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea 1G Apr 24 19:20:49 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Acquiring lock "cinder-quobyte-09359b91-b397-400d-ad9b-a7cdb46ee06d" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Lock "cinder-quobyte-09359b91-b397-400d-ad9b-a7cdb46ee06d" acquired by "delete_volume" :: waited 0.014s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:49 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacd76f6-d2ce-40a0-a7e0-bdfd051e7c49]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:49 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d Apr 24 19:20:49 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:50 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d" returned: 0 in 0.583s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:50 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d Apr 24 19:20:50 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:50 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea 1G" returned: 0 in 0.753s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:50 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea Apr 24 19:20:50 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:50 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-09359b91-b397-400d-ad9b-a7cdb46ee06d" returned: 0 in 0.520s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Lock "cinder-quobyte-09359b91-b397-400d-ad9b-a7cdb46ee06d" released by "delete_volume" :: held 1.147s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Created reservations ['1f77ad7d-3abe-415a-a414-a1b90e180914', '8bedf0bc-4e75-451f-9eb4-e10e62097d9a', 'bb883e3c-5250-4314-afc4-3562286678c6', '051dba71-cb27-4822-8ef5-d817ad1a2c2e'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:50 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea" returned: 0 in 0.580s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:50 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea is being set with open permissions: ugo+rw Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:50 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea Apr 24 19:20:50 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:50 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:50 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:51 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.477s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:51 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:20:51 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea" returned: 0 in 0.502s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:51 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Deleted volume successfully. Apr 24 19:20:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-49d51e8c-ca81-48c4-b249-28e9ac529308 tempest-VolumesTransfersV357Test-2044356860 None] Lock "cinder-09359b91-b397-400d-ad9b-a7cdb46ee06d-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:51 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.info Apr 24 19:20:51 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:52 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.info" returned: 0 in 0.573s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:52 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.info is being set with open permissions: ugo+rw Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:52 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.info Apr 24 19:20:52 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Flow 'volume_create_manager' (7172a835-49be-4d1e-9eb1-7307ae341465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e5752d-9ce9-4577-a238-3dfdd3e2fde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e5752d-9ce9-4577-a238-3dfdd3e2fde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-750109804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182ea776-1940-4f68-98d9-6c766a1ef548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b6e1670d344cf294725dd9cff55298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:52Z,use_quota=True,user_id='10c0d9bb63964bec9d1cfc88719a614e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7780b4-f3b1-4b4e-90fb-e7d4dec2ad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7780b4-f3b1-4b4e-90fb-e7d4dec2ad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4ee99a-2174-46ff-b7a9-63d4ed60dfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4ee99a-2174-46ff-b7a9-63d4ed60dfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182ea776-1940-4f68-98d9-6c766a1ef548', 'volume_name': 'volume-182ea776-1940-4f68-98d9-6c766a1ef548', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8f8007-f7a6-4deb-b2cd-896a9a1c73e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8f8007-f7a6-4deb-b2cd-896a9a1c73e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49b7a64-8c9e-4cf0-8875-c7640f91431b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:52 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Volume 182ea776-1940-4f68-98d9-6c766a1ef548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182ea776-1940-4f68-98d9-6c766a1ef548', 'volume_size': 1} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:52 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.info" returned: 0 in 0.612s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.813s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-750109804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182ea776-1940-4f68-98d9-6c766a1ef548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31b6e1670d344cf294725dd9cff55298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:52Z,use_quota=True,user_id='10c0d9bb63964bec9d1cfc88719a614e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Creating volume 182ea776-1940-4f68-98d9-6c766a1ef548 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:52 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:20:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:52 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548 1073741824 Apr 24 19:20:52 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:52 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-871bcd5a-8321-4393-a3c7-892c9acba7cd tempest-VolumeDependencyTests-238870211 None] Create snapshot completed successfully Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Flow 'volume_create_manager' (f5e6bd55-257a-42a3-ae69-4853971d3975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:53 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076e3321-2868-4b43-9b4b-836c6adecbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548 1073741824" returned: 0 in 0.959s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076e3321-2868-4b43-9b4b-836c6adecbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-233890046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71a8b2e-0069-42fc-89e0-f3603f57901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74161ac24004c31be3c12a026602192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b7f86714-833f-4cab-9168-43a40022a6ea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:20:54Z,use_quota=True,user_id='14cc4d0ce0c84d828b58d833b1afc22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf45bc18-b435-449c-b3c9-91719704ea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf45bc18-b435-449c-b3c9-91719704ea08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07dfb579-bc7a-4a18-8cd1-43e82ee848b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07dfb579-bc7a-4a18-8cd1-43e82ee848b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd71a8b2e-0069-42fc-89e0-f3603f57901e', 'volume_name': 'volume-d71a8b2e-0069-42fc-89e0-f3603f57901e', 'volume_size': 1, 'snapshot_id': 'b7f86714-833f-4cab-9168-43a40022a6ea'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca121157-3b29-421d-9b91-acc212451b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca121157-3b29-421d-9b91-acc212451b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a94e542-a7d1-47a1-9fb3-01d32ea79633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:53 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Volume d71a8b2e-0069-42fc-89e0-f3603f57901e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d71a8b2e-0069-42fc-89e0-f3603f57901e', 'volume_size': 1, 'snapshot_id': 'b7f86714-833f-4cab-9168-43a40022a6ea'} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:53 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548 Apr 24 19:20:53 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:54 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548" returned: 0 in 0.547s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.575s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-quobyte-b7f86714-833f-4cab-9168-43a40022a6ea-d71a8b2e-0069-42fc-89e0-f3603f57901e" by "_create_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49b7a64-8c9e-4cf0-8875-c7640f91431b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182ea776-1940-4f68-98d9-6c766a1ef548', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed05381-47b1-4955-acf8-26288eaff276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:20:54 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Volume volume-182ea776-1940-4f68-98d9-6c766a1ef548 (182ea776-1940-4f68-98d9-6c766a1ef548): created successfully Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed05381-47b1-4955-acf8-26288eaff276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Flow 'volume_create_manager' (7172a835-49be-4d1e-9eb1-7307ae341465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-b7f86714-833f-4cab-9168-43a40022a6ea-d71a8b2e-0069-42fc-89e0-f3603f57901e" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Creating volume d71a8b2e-0069-42fc-89e0-f3603f57901e from snapshot b7f86714-833f-4cab-9168-43a40022a6ea {{(pid=82057) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-quobyte-d71a8b2e-0069-42fc-89e0-f3603f57901e" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:54 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-aefd78fc-05de-430a-8816-54bac1bbff5c tempest-VolumesTransfersV357Test-1390459323 None] Created volume successfully. Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-d71a8b2e-0069-42fc-89e0-f3603f57901e" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] snapshot: b7f86714-833f-4cab-9168-43a40022a6ea, volume: d71a8b2e-0069-42fc-89e0-f3603f57901e, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a21a31-f493-4c95-9318-9c9b2e03f04a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:54 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea Apr 24 19:20:54 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:55 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea" returned: 0 in 0.558s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d33ec3-6aa0-4d17-8899-f9736ce16e1f]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:55 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 Apr 24 19:20:55 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:55 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763" returned: 0 in 0.657s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:55 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e Apr 24 19:20:55 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Acquiring lock "cinder-182ea776-1940-4f68-98d9-6c766a1ef548-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Lock "cinder-182ea776-1940-4f68-98d9-6c766a1ef548-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Acquiring lock "cinder-quobyte-182ea776-1940-4f68-98d9-6c766a1ef548" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Lock "cinder-quobyte-182ea776-1940-4f68-98d9-6c766a1ef548" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[870dfbc5-c783-4816-ae27-b492f7bc1770]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:20:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:56 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548 Apr 24 19:20:56 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:56 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548" returned: 0 in 1.050s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:57 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548 Apr 24 19:20:57 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:58 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-182ea776-1940-4f68-98d9-6c766a1ef548" returned: 0 in 1.348s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Lock "cinder-quobyte-182ea776-1940-4f68-98d9-6c766a1ef548" released by "delete_volume" :: held 2.493s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=121,cinder:INSERT=39,cinder:UPDATE=161,cinder:DELETE=16 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:20:58 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:58 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Created reservations ['c78a5924-c4aa-494e-9f18-5fb4336630c7', '84bfeadf-a398-4486-87de-6a9f6e10b49c', 'f26f2909-37f6-4f29-90f7-8803d6c2df78', '7a9661d6-b2a5-4eae-b358-817067cbe6bf'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:20:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:20:58 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:20:58 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:00 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.657s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:00 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:00 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.316s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:00 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:00 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Deleted volume successfully. Apr 24 19:21:00 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-29a0e4fb-5962-4cf4-b9df-f74a6f2f92ce tempest-VolumesTransfersV357Test-2044356860 None] Lock "cinder-182ea776-1940-4f68-98d9-6c766a1ef548-delete_volume" released by "delete_volume" :: held 4.373s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:02 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e" returned: 0 in 7.037s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:02 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe14d0f-a545-456f-9fef-91e13cc1bb7c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:02 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 Apr 24 19:21:02 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9fc4d23e-80a5-4505-9555-5211789660e5 tempest-VolumesActionsTest-999936458 None] Acquiring lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f" by "attach_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9fc4d23e-80a5-4505-9555-5211789660e5 tempest-VolumesActionsTest-999936458 None] Lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f" acquired by "attach_volume" :: waited 0.031s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:04 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763" returned: 0 in 1.576s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:04 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763, size 1024.00 MB, duration 7.04 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:21:04 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Converted 1024.00 MB image at 145.48 MB/s Apr 24 19:21:04 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e is being set with open permissions: ugo+rw Apr 24 19:21:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:04 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e Apr 24 19:21:04 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:04 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9fc4d23e-80a5-4505-9555-5211789660e5 tempest-VolumesActionsTest-999936458 None] Attaching volume 92582c0b-6e7e-4963-933e-2656aaeb3f6f to instance ba401548-2eb0-42d7-88f4-1238f5296aa7 at mountpoint /dev/vdb on host None. Apr 24 19:21:04 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9fc4d23e-80a5-4505-9555-5211789660e5 tempest-VolumesActionsTest-999936458 None] Attach volume completed successfully. Apr 24 19:21:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9fc4d23e-80a5-4505-9555-5211789660e5 tempest-VolumesActionsTest-999936458 None] Lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f" released by "attach_volume" :: held 0.155s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9ff3600c-1d6e-48c0-8be0-fcd18b1c5322 tempest-VolumesActionsTest-999936458 None] Acquiring lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f-detach_volume" by "detach_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9ff3600c-1d6e-48c0-8be0-fcd18b1c5322 tempest-VolumesActionsTest-999936458 None] Lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:04 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9ff3600c-1d6e-48c0-8be0-fcd18b1c5322 tempest-VolumesActionsTest-999936458 None] Detaching volume 92582c0b-6e7e-4963-933e-2656aaeb3f6f from instance ba401548-2eb0-42d7-88f4-1238f5296aa7. Apr 24 19:21:05 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9ff3600c-1d6e-48c0-8be0-fcd18b1c5322 tempest-VolumesActionsTest-999936458 None] Detach volume completed successfully. Apr 24 19:21:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9ff3600c-1d6e-48c0-8be0-fcd18b1c5322 tempest-VolumesActionsTest-999936458 None] Lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:05 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e" returned: 0 in 0.720s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-d71a8b2e-0069-42fc-89e0-f3603f57901e" released by "_copy_volume_from_snapshot" :: held 10.677s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-b7f86714-833f-4cab-9168-43a40022a6ea-d71a8b2e-0069-42fc-89e0-f3603f57901e" released by "_create_volume_from_snapshot" :: held 10.735s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.782s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a94e542-a7d1-47a1-9fb3-01d32ea79633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71a8b2e-0069-42fc-89e0-f3603f57901e', 'volume_size': 1, 'snapshot_id': 'b7f86714-833f-4cab-9168-43a40022a6ea'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5567b85b-2f57-45cd-8d03-84bc2adf7e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:05 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Volume volume-d71a8b2e-0069-42fc-89e0-f3603f57901e (d71a8b2e-0069-42fc-89e0-f3603f57901e): created successfully Apr 24 19:21:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5567b85b-2f57-45cd-8d03-84bc2adf7e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Flow 'volume_create_manager' (f5e6bd55-257a-42a3-ae69-4853971d3975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:05 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-45885bda-5e5c-414e-b3d5-f66e82d545ce tempest-VolumeDependencyTests-238870211 None] Created volume successfully. Apr 24 19:21:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-b7f86714-833f-4cab-9168-43a40022a6ea-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Lock "cinder-b7f86714-833f-4cab-9168-43a40022a6ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-quobyte-27ba8eca-9c2d-4d4c-b937-4293cfb80763" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-27ba8eca-9c2d-4d4c-b937-4293cfb80763" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-quobyte-b7f86714-833f-4cab-9168-43a40022a6ea" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-b7f86714-833f-4cab-9168-43a40022a6ea" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Deleting offline snapshot b7f86714-833f-4cab-9168-43a40022a6ea of volume 27ba8eca-9c2d-4d4c-b937-4293cfb80763 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:21:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] snapshot_file for this snap is: volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:21:06 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f27c112-c396-48bb-b8db-41175a07c916]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:06 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea Apr 24 19:21:06 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:07 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea" returned: 0 in 0.954s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:07 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bc07ea-3857-4d41-a068-a5345376750e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:07 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 Apr 24 19:21:07 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:08 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763" returned: 0 in 0.829s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:08 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea Apr 24 19:21:08 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:09 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea" returned: 0 in 0.873s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:09 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea Apr 24 19:21:09 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Flow 'volume_create_manager' (ba1b5a08-b4a5-4593-be13-e914de77f84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bf68e9-d70b-44eb-b271-e33e85aa69e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bf68e9-d70b-44eb-b271-e33e85aa69e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1377007579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5095612d-713f-4ce5-849d-ebe78b2145cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c62a6a476334c6f8da3694d19b2825e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:09Z,use_quota=True,user_id='93ec788d115c445aafb15c79d55db36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78b789f-4cee-4291-8317-f2389b9a0c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78b789f-4cee-4291-8317-f2389b9a0c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660c4fd0-72d6-47e5-b78c-33139cf31471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660c4fd0-72d6-47e5-b78c-33139cf31471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5095612d-713f-4ce5-849d-ebe78b2145cb', 'volume_name': 'volume-5095612d-713f-4ce5-849d-ebe78b2145cb', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16bf265-47d4-42ed-afe7-ca94f6a3af9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16bf265-47d4-42ed-afe7-ca94f6a3af9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c3e383-0b5f-43cb-b3ef-827886ddc468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:09 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Volume 5095612d-713f-4ce5-849d-ebe78b2145cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5095612d-713f-4ce5-849d-ebe78b2145cb', 'volume_size': 1} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1377007579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5095612d-713f-4ce5-849d-ebe78b2145cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c62a6a476334c6f8da3694d19b2825e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:09Z,use_quota=True,user_id='93ec788d115c445aafb15c79d55db36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Creating volume 5095612d-713f-4ce5-849d-ebe78b2145cb {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:09 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:09 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb 1073741824 Apr 24 19:21:09 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:09 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763.b7f86714-833f-4cab-9168-43a40022a6ea" returned: 0 in 0.524s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-b7f86714-833f-4cab-9168-43a40022a6ea" released by "_delete_snapshot" :: held 3.358s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-27ba8eca-9c2d-4d4c-b937-4293cfb80763" released by "delete_snapshot" :: held 3.389s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:09 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Created reservations ['e5b944f5-ef74-406c-bc7a-a9c781019619', 'd83adff9-4b5a-4dc7-b2d2-e1898f3e7a48', '6f32bd91-bb94-4098-b438-ae24b902ee04', '4b5c2a18-c32c-4b47-99ab-a73d54420cb9'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:09 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Delete snapshot completed successfully. Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e5ef490c-ba45-4ae2-9cc8-bdf39212065a tempest-VolumeDependencyTests-238870211 None] Lock "cinder-b7f86714-833f-4cab-9168-43a40022a6ea-delete_snapshot" released by "delete_snapshot" :: held 3.601s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:10 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb 1073741824" returned: 0 in 0.720s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:10 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb Apr 24 19:21:10 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:10 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb" returned: 0 in 0.522s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-27ba8eca-9c2d-4d4c-b937-4293cfb80763-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c3e383-0b5f-43cb-b3ef-827886ddc468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5095612d-713f-4ce5-849d-ebe78b2145cb', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d445c4-076b-4818-917f-69978f4afd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-27ba8eca-9c2d-4d4c-b937-4293cfb80763-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:10 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Volume volume-5095612d-713f-4ce5-849d-ebe78b2145cb (5095612d-713f-4ce5-849d-ebe78b2145cb): created successfully Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d445c4-076b-4818-917f-69978f4afd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Flow 'volume_create_manager' (ba1b5a08-b4a5-4593-be13-e914de77f84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:10 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-ec2e4fc2-3831-41cf-80b2-819a1169bc39 tempest-VolumesCloneTest-401477434 None] Created volume successfully. Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-quobyte-27ba8eca-9c2d-4d4c-b937-4293cfb80763" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-27ba8eca-9c2d-4d4c-b937-4293cfb80763" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8869a90-475d-4e73-9a6b-9fef45f3ce0f]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:10 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 Apr 24 19:21:10 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:11 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763" returned: 0 in 0.623s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:11 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763 Apr 24 19:21:11 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Flow 'volume_create_manager' (3283b6d5-a5d5-428a-b583-be1b54e563d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67790ce6-a64f-4870-ae84-dbe9b0f44d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67790ce6-a64f-4870-ae84-dbe9b0f44d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1411293053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929d61d8-531d-4d90-8577-7f39e7e5cd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c62a6a476334c6f8da3694d19b2825e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5095612d-713f-4ce5-849d-ebe78b2145cb,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:12Z,use_quota=True,user_id='93ec788d115c445aafb15c79d55db36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664a864b-3b2f-4a15-9b03-ece5fa94ea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664a864b-3b2f-4a15-9b03-ece5fa94ea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2d5748-9321-4e56-95f6-fadf90dcf9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2d5748-9321-4e56-95f6-fadf90dcf9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '929d61d8-531d-4d90-8577-7f39e7e5cd29', 'volume_name': 'volume-929d61d8-531d-4d90-8577-7f39e7e5cd29', 'volume_size': 2, 'source_volid': '5095612d-713f-4ce5-849d-ebe78b2145cb', 'source_volstatus': 'available'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12021004-a74b-4b67-a43b-8a3502e7a3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12021004-a74b-4b67-a43b-8a3502e7a3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a00df3d-ef21-4795-9f3a-7dc2b5e6ff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:11 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Volume 929d61d8-531d-4d90-8577-7f39e7e5cd29: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-929d61d8-531d-4d90-8577-7f39e7e5cd29', 'volume_size': 2, 'source_volid': '5095612d-713f-4ce5-849d-ebe78b2145cb', 'source_volstatus': 'available'} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:11 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Cloning volume 5095612d-713f-4ce5-849d-ebe78b2145cb to volume 929d61d8-531d-4d90-8577-7f39e7e5cd29 Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Creating offline snapshot a219c077-2af7-47f0-be57-8b337fd0864f of volume 5095612d-713f-4ce5-849d-ebe78b2145cb {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d367b7-1b18-453e-8398-71a6943d7877]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:11 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb Apr 24 19:21:11 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:11 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-27ba8eca-9c2d-4d4c-b937-4293cfb80763" returned: 0 in 0.534s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-27ba8eca-9c2d-4d4c-b937-4293cfb80763" released by "delete_volume" :: held 1.229s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Created reservations ['e96b6bde-afce-429f-a7e6-f32444a3e95d', '3c540865-a904-4f03-a0c6-ccbcceed2c5b', '15378678-4dc7-4b0f-93e8-943f4689713f', '12005282-84d9-4084-80c9-119538812705'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:12 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:21:12 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:12 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb" returned: 0 in 0.639s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:12 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f 1G Apr 24 19:21:12 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:12 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.502s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:12 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Deleted volume successfully. Apr 24 19:21:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73b0993e-6717-4294-9737-12c9461a5795 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-27ba8eca-9c2d-4d4c-b937-4293cfb80763-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:13 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f 1G" returned: 0 in 0.690s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5095612d-713f-4ce5-849d-ebe78b2145cb -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:13 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5095612d-713f-4ce5-849d-ebe78b2145cb -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f Apr 24 19:21:13 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Flow 'volume_create_manager' (989ce80a-baf0-478f-bbe5-7df562c0fbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bd6e7c-b23a-4f49-bf92-3baf76043587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bd6e7c-b23a-4f49-bf92-3baf76043587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1000854140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4e76e0-748b-435c-a7ae-af386149aa6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74161ac24004c31be3c12a026602192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:13Z,use_quota=True,user_id='14cc4d0ce0c84d828b58d833b1afc22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcba8ca-d8d1-4781-a5d4-b43eacfc9df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dcba8ca-d8d1-4781-a5d4-b43eacfc9df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd70b35-0d1c-4bf6-9dfc-b6a6562f4bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd70b35-0d1c-4bf6-9dfc-b6a6562f4bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b4e76e0-748b-435c-a7ae-af386149aa6a', 'volume_name': 'volume-9b4e76e0-748b-435c-a7ae-af386149aa6a', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3e43c5-0c8e-4238-bdab-9893f0842aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c3e43c5-0c8e-4238-bdab-9893f0842aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d80c169-894f-44f3-9f71-91c64b7def2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:13 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Volume 9b4e76e0-748b-435c-a7ae-af386149aa6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b4e76e0-748b-435c-a7ae-af386149aa6a', 'volume_size': 1} Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:13 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5095612d-713f-4ce5-849d-ebe78b2145cb -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f" returned: 0 in 0.625s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:13 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f is being set with open permissions: ugo+rw Apr 24 19:21:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:13 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f Apr 24 19:21:13 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:14 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f" returned: 0 in 0.584s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:14 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.info Apr 24 19:21:14 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:14 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.info" returned: 0 in 0.461s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:14 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.info is being set with open permissions: ugo+rw Apr 24 19:21:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:14 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.info Apr 24 19:21:14 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:15 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.info" returned: 0 in 0.472s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Acquiring lock "cinder-quobyte-929d61d8-531d-4d90-8577-7f39e7e5cd29" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Lock "cinder-quobyte-929d61d8-531d-4d90-8577-7f39e7e5cd29" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] snapshot: a219c077-2af7-47f0-be57-8b337fd0864f, volume: 929d61d8-531d-4d90-8577-7f39e7e5cd29, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b010dfc3-dcba-4745-ae21-d2a66de2a92a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:15 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f Apr 24 19:21:15 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:15 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f" returned: 0 in 0.553s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5095612d-713f-4ce5-849d-ebe78b2145cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:21:15 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:21:16 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3c302e-3fd9-4755-86aa-a1bc9c492482]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:16 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb Apr 24 19:21:16 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:16 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb" returned: 0 in 0.552s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:16 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:21:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:16 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 Apr 24 19:21:16 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:22 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29" returned: 0 in 6.353s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:22 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dbb10f-6ef7-4dda-b989-2d9bca44a634]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:23 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb Apr 24 19:21:23 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:23 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb" returned: 0 in 0.804s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:23 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:21:23 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Converted 1024.00 MB image at 161.12 MB/s Apr 24 19:21:23 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 is being set with open permissions: ugo+rw Apr 24 19:21:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:23 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 Apr 24 19:21:23 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:24 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29" returned: 0 in 0.588s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Lock "cinder-quobyte-929d61d8-531d-4d90-8577-7f39e7e5cd29" released by "_copy_volume_from_snapshot" :: held 8.934s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Acquiring lock "cinder-quobyte-a219c077-2af7-47f0-be57-8b337fd0864f" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Lock "cinder-quobyte-a219c077-2af7-47f0-be57-8b337fd0864f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Deleting offline snapshot a219c077-2af7-47f0-be57-8b337fd0864f of volume 5095612d-713f-4ce5-849d-ebe78b2145cb {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:21:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] snapshot_file for this snap is: volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:21:24 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:UPDATE=103,cinder:SELECT=74,cinder:INSERT=25,cinder:DELETE=4 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:21:24 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b560f2-f66a-4101-a991-6b8c3e909202]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:24 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f Apr 24 19:21:24 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:25 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f" returned: 0 in 0.572s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5095612d-713f-4ce5-849d-ebe78b2145cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:25 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[06184d36-d514-4c9f-9435-1f66e9a436e2]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:25 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb Apr 24 19:21:25 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:25 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb" returned: 0 in 0.593s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:25 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f Apr 24 19:21:25 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:26 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f" returned: 0 in 0.555s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:26 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f Apr 24 19:21:26 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:26 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb.a219c077-2af7-47f0-be57-8b337fd0864f" returned: 0 in 0.479s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Lock "cinder-quobyte-a219c077-2af7-47f0-be57-8b337fd0864f" released by "_delete_snapshot" :: held 2.330s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.926s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.379s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1000854140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4e76e0-748b-435c-a7ae-af386149aa6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74161ac24004c31be3c12a026602192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:13Z,use_quota=True,user_id='14cc4d0ce0c84d828b58d833b1afc22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Creating volume 9b4e76e0-748b-435c-a7ae-af386149aa6a {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:26 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:26 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a 1073741824 Apr 24 19:21:26 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a00df3d-ef21-4795-9f3a-7dc2b5e6ff69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929d61d8-531d-4d90-8577-7f39e7e5cd29', 'volume_size': 2, 'source_volid': '5095612d-713f-4ce5-849d-ebe78b2145cb', 'source_volstatus': 'available'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58bf918-4ebd-4bdb-9212-7ff967889b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:26 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Volume volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 (929d61d8-531d-4d90-8577-7f39e7e5cd29): created successfully Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58bf918-4ebd-4bdb-9212-7ff967889b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Flow 'volume_create_manager' (3283b6d5-a5d5-428a-b583-be1b54e563d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:26 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-a25da376-5745-40aa-91da-bac946914f9f tempest-VolumesCloneTest-401477434 None] Created volume successfully. Apr 24 19:21:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Acquiring lock "cinder-929d61d8-531d-4d90-8577-7f39e7e5cd29-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Lock "cinder-929d61d8-531d-4d90-8577-7f39e7e5cd29-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Acquiring lock "cinder-quobyte-929d61d8-531d-4d90-8577-7f39e7e5cd29" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Lock "cinder-quobyte-929d61d8-531d-4d90-8577-7f39e7e5cd29" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:27 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5bcad5-57ef-471b-9fbc-762769cabfef]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:27 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 Apr 24 19:21:27 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:27 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a 1073741824" returned: 0 in 0.703s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:27 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a Apr 24 19:21:27 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:27 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29" returned: 0 in 0.581s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:27 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29 Apr 24 19:21:27 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:28 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a" returned: 0 in 0.520s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d80c169-894f-44f3-9f71-91c64b7def2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4e76e0-748b-435c-a7ae-af386149aa6a', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00cb89a-6a1d-4512-8533-918e40458e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:28 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Volume volume-9b4e76e0-748b-435c-a7ae-af386149aa6a (9b4e76e0-748b-435c-a7ae-af386149aa6a): created successfully Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00cb89a-6a1d-4512-8533-918e40458e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Flow 'volume_create_manager' (989ce80a-baf0-478f-bbe5-7df562c0fbe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7fd3a2f8-0e8e-4698-91af-950e8218d34c tempest-VolumeDependencyTests-238870211 None] Created volume successfully. Apr 24 19:21:28 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-929d61d8-531d-4d90-8577-7f39e7e5cd29" returned: 0 in 0.512s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Lock "cinder-quobyte-929d61d8-531d-4d90-8577-7f39e7e5cd29" released by "delete_volume" :: held 1.141s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Created reservations ['cd3959b6-5fb3-4395-ad1c-378607a23e13', 'b74eea93-8695-4332-a2ea-c24caf73c49b', '8bfbe0e4-74c2-4b94-b344-b4fdefb1bdc4', '0a57c666-e43e-42d8-accf-ee3b552b2f98'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:28 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:21:28 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:29 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.515s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:29 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Deleted volume successfully. Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c2a57aaa-e42a-4ee3-90b2-1ece5927f410 tempest-VolumesCloneTest-401477434 None] Lock "cinder-929d61d8-531d-4d90-8577-7f39e7e5cd29-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Flow 'volume_create_manager' (359dfc02-b06e-43c4-a295-b90a90e36610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4dfa33-9e27-4c7f-b6f4-be241ebb5a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4dfa33-9e27-4c7f-b6f4-be241ebb5a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-575977685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10de2611-fb84-4ba1-be4e-204e4e550670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74161ac24004c31be3c12a026602192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9b4e76e0-748b-435c-a7ae-af386149aa6a,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:29Z,use_quota=True,user_id='14cc4d0ce0c84d828b58d833b1afc22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ea75f7-bad9-4128-a52f-b785b81deff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ea75f7-bad9-4128-a52f-b785b81deff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0d03b6-e76c-4a2b-954d-cda3354447eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0d03b6-e76c-4a2b-954d-cda3354447eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '10de2611-fb84-4ba1-be4e-204e4e550670', 'volume_name': 'volume-10de2611-fb84-4ba1-be4e-204e4e550670', 'volume_size': 1, 'source_volid': '9b4e76e0-748b-435c-a7ae-af386149aa6a', 'source_volstatus': 'available'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f40f223-3b04-47ee-b396-c2c21f11949d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f40f223-3b04-47ee-b396-c2c21f11949d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3027acfe-e0d7-4c77-ba56-5b76b7813ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:29 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Volume 10de2611-fb84-4ba1-be4e-204e4e550670: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-10de2611-fb84-4ba1-be4e-204e4e550670', 'volume_size': 1, 'source_volid': '9b4e76e0-748b-435c-a7ae-af386149aa6a', 'source_volstatus': 'available'} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:29 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Cloning volume 9b4e76e0-748b-435c-a7ae-af386149aa6a to volume 10de2611-fb84-4ba1-be4e-204e4e550670 Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Creating offline snapshot a5850ecb-907a-459b-8258-8de24cd0e567 of volume 9b4e76e0-748b-435c-a7ae-af386149aa6a {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfec087-f01e-490b-a334-4104077ce9ef]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:29 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a Apr 24 19:21:29 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Acquiring lock "cinder-5095612d-713f-4ce5-849d-ebe78b2145cb-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Lock "cinder-5095612d-713f-4ce5-849d-ebe78b2145cb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Acquiring lock "cinder-quobyte-5095612d-713f-4ce5-849d-ebe78b2145cb" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Lock "cinder-quobyte-5095612d-713f-4ce5-849d-ebe78b2145cb" acquired by "delete_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4ba06d-3a8c-4d9e-9dd6-34d3ca92c6b4]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:29 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb Apr 24 19:21:29 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:30 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a" returned: 0 in 0.842s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:30 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 1G Apr 24 19:21:30 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:30 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb" returned: 0 in 0.901s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:30 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb Apr 24 19:21:30 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:31 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 1G" returned: 0 in 0.943s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4e76e0-748b-435c-a7ae-af386149aa6a -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:31 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4e76e0-748b-435c-a7ae-af386149aa6a -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 Apr 24 19:21:31 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:31 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5095612d-713f-4ce5-849d-ebe78b2145cb" returned: 0 in 0.578s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Lock "cinder-quobyte-5095612d-713f-4ce5-849d-ebe78b2145cb" released by "delete_volume" :: held 1.640s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Created reservations ['34f60025-307f-4dfb-9adf-3dae9223cf03', 'a7511b53-c2a5-4cf7-865d-e30431038f64', '9bb2128d-1cb4-4695-b669-ff353f9e5173', '96bd4dc0-56a9-46a5-89c5-e241912f6bc5'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:31 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:21:31 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:31 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b4e76e0-748b-435c-a7ae-af386149aa6a -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567" returned: 0 in 0.582s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:31 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 is being set with open permissions: ugo+rw Apr 24 19:21:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:31 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 Apr 24 19:21:31 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:32 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.815s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:32 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:32 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Deleted volume successfully. Apr 24 19:21:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ebbb2214-16a7-457a-994e-01108a79a534 tempest-VolumesCloneTest-401477434 None] Lock "cinder-5095612d-713f-4ce5-849d-ebe78b2145cb-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:32 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567" returned: 0 in 0.669s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:32 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.info Apr 24 19:21:32 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:33 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.info" returned: 0 in 0.714s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:33 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.info is being set with open permissions: ugo+rw Apr 24 19:21:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:33 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.info Apr 24 19:21:33 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6ff45515-dfa5-4cd0-a19f-55b9d18e6b78 tempest-VolumesActionsTest-999936458 None] Acquiring lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f" by "attach_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6ff45515-dfa5-4cd0-a19f-55b9d18e6b78 tempest-VolumesActionsTest-999936458 None] Lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f" acquired by "attach_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:33 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.info" returned: 0 in 0.865s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-quobyte-10de2611-fb84-4ba1-be4e-204e4e550670" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:34 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6ff45515-dfa5-4cd0-a19f-55b9d18e6b78 tempest-VolumesActionsTest-999936458 None] Attaching volume 92582c0b-6e7e-4963-933e-2656aaeb3f6f to instance 193ada48-75a8-48aa-a2aa-c4874677d4dc at mountpoint /dev/vdb on host None. Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-10de2611-fb84-4ba1-be4e-204e4e550670" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] snapshot: a5850ecb-907a-459b-8258-8de24cd0e567, volume: 10de2611-fb84-4ba1-be4e-204e4e550670, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:34 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6ff45515-dfa5-4cd0-a19f-55b9d18e6b78 tempest-VolumesActionsTest-999936458 None] Attach volume completed successfully. Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e13b46-0c30-439d-aa00-0484fa4a67ec]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6ff45515-dfa5-4cd0-a19f-55b9d18e6b78 tempest-VolumesActionsTest-999936458 None] Lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f" released by "attach_volume" :: held 0.199s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:34 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 Apr 24 19:21:34 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-af793f0a-6248-4841-9b81-a781246d5329 tempest-VolumesActionsTest-999936458 None] Acquiring lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f-detach_volume" by "detach_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-af793f0a-6248-4841-9b81-a781246d5329 tempest-VolumesActionsTest-999936458 None] Lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:34 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-af793f0a-6248-4841-9b81-a781246d5329 tempest-VolumesActionsTest-999936458 None] Detaching volume 92582c0b-6e7e-4963-933e-2656aaeb3f6f from instance 193ada48-75a8-48aa-a2aa-c4874677d4dc. Apr 24 19:21:34 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-af793f0a-6248-4841-9b81-a781246d5329 tempest-VolumesActionsTest-999936458 None] Detach volume completed successfully. Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-af793f0a-6248-4841-9b81-a781246d5329 tempest-VolumesActionsTest-999936458 None] Lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:34 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567" returned: 0 in 0.845s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b4e76e0-748b-435c-a7ae-af386149aa6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ea971d-7ca0-42af-bc35-2a7eb854a147]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:35 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a Apr 24 19:21:35 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Flow 'volume_create_manager' (1d956044-003a-407a-b36d-739e0426e4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d6bdf3-81a9-4541-bc73-f093f81157dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d6bdf3-81a9-4541-bc73-f093f81157dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-631982980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d9e828-1780-4b19-9268-a2e5a45f681a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='897e32e7c5964caebfde8b4915800d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:36Z,use_quota=True,user_id='45d33b5c56534b878a371c4c5b318e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20265faa-d606-4c13-9de3-de5ca20477e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20265faa-d606-4c13-9de3-de5ca20477e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1bb384-7b83-44c0-b2c4-d9c10d1611a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1bb384-7b83-44c0-b2c4-d9c10d1611a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d9e828-1780-4b19-9268-a2e5a45f681a', 'volume_name': 'volume-a9d9e828-1780-4b19-9268-a2e5a45f681a', 'volume_size': 2}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05ade41-6ed5-4033-9912-e5673884a9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f05ade41-6ed5-4033-9912-e5673884a9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658f7d14-61e8-4567-9558-eca9d667e93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:35 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Volume a9d9e828-1780-4b19-9268-a2e5a45f681a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d9e828-1780-4b19-9268-a2e5a45f681a', 'volume_size': 2} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:35 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a" returned: 0 in 0.870s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670 not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:21:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:35 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670 Apr 24 19:21:35 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:42 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670" returned: 0 in 6.213s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:42 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c7b88d-17f2-4afb-b738-6f7c5aca9355]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:42 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a Apr 24 19:21:42 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:42 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a" returned: 0 in 0.764s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:42 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670 {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:21:42 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Converted 1024.00 MB image at 164.76 MB/s Apr 24 19:21:42 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670 is being set with open permissions: ugo+rw Apr 24 19:21:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:42 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670 Apr 24 19:21:42 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:43 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670" returned: 0 in 0.458s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-10de2611-fb84-4ba1-be4e-204e4e550670" released by "_copy_volume_from_snapshot" :: held 9.254s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-quobyte-a5850ecb-907a-459b-8258-8de24cd0e567" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-a5850ecb-907a-459b-8258-8de24cd0e567" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Deleting offline snapshot a5850ecb-907a-459b-8258-8de24cd0e567 of volume 9b4e76e0-748b-435c-a7ae-af386149aa6a {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] snapshot_file for this snap is: volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[96affced-c5d6-452c-893a-a9b66ce7efdb]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:43 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 Apr 24 19:21:43 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:43 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567" returned: 0 in 0.571s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b4e76e0-748b-435c-a7ae-af386149aa6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e02dbab-ac6a-4788-ae7a-d7ac2f6cab83]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:44 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a Apr 24 19:21:44 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:44 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a" returned: 0 in 0.599s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:44 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 Apr 24 19:21:44 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:45 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567" returned: 0 in 0.699s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:45 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567 Apr 24 19:21:45 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=49,cinder:INSERT=17,cinder:UPDATE=49,cinder:DELETE=6 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:21:45 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a.a5850ecb-907a-459b-8258-8de24cd0e567" returned: 0 in 0.488s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-a5850ecb-907a-459b-8258-8de24cd0e567" released by "_delete_snapshot" :: held 2.460s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.577s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.144s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-631982980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d9e828-1780-4b19-9268-a2e5a45f681a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='897e32e7c5964caebfde8b4915800d4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:36Z,use_quota=True,user_id='45d33b5c56534b878a371c4c5b318e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Creating volume a9d9e828-1780-4b19-9268-a2e5a45f681a {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:21:45 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a 2147483648 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:45 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a 2147483648 Apr 24 19:21:45 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3027acfe-e0d7-4c77-ba56-5b76b7813ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10de2611-fb84-4ba1-be4e-204e4e550670', 'volume_size': 1, 'source_volid': '9b4e76e0-748b-435c-a7ae-af386149aa6a', 'source_volstatus': 'available'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5231894-74a9-423f-998d-cc139e587cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:45 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Volume volume-10de2611-fb84-4ba1-be4e-204e4e550670 (10de2611-fb84-4ba1-be4e-204e4e550670): created successfully Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5231894-74a9-423f-998d-cc139e587cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Flow 'volume_create_manager' (359dfc02-b06e-43c4-a295-b90a90e36610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:45 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-50ef200a-9e88-4db9-a004-abe55fc3adef tempest-VolumeDependencyTests-238870211 None] Created volume successfully. Apr 24 19:21:46 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a 2147483648" returned: 0 in 0.661s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:46 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a Apr 24 19:21:46 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:46 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-9b4e76e0-748b-435c-a7ae-af386149aa6a-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-9b4e76e0-748b-435c-a7ae-af386149aa6a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-quobyte-9b4e76e0-748b-435c-a7ae-af386149aa6a" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-9b4e76e0-748b-435c-a7ae-af386149aa6a" acquired by "delete_volume" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:47 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a" returned: 0 in 0.536s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.249s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa94e99d-114f-4a8b-bb9d-8c60a05614cc]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aec81b-9263-4e38-b598-72dc6c4dfefa]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658f7d14-61e8-4567-9558-eca9d667e93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d9e828-1780-4b19-9268-a2e5a45f681a', 'volume_size': 2}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6905dd83-7b9f-47e7-90f4-b890b89fd2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:47 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Volume volume-a9d9e828-1780-4b19-9268-a2e5a45f681a (a9d9e828-1780-4b19-9268-a2e5a45f681a): created successfully Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6905dd83-7b9f-47e7-90f4-b890b89fd2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Flow 'volume_create_manager' (1d956044-003a-407a-b36d-739e0426e4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:47 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-df156b1e-015e-4623-8ee2-e30625faa456 tempest-VolumesCloneNegativeTest-116288146 None] Created volume successfully. Apr 24 19:21:47 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a Apr 24 19:21:47 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:47 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f Apr 24 19:21:47 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:47 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a" returned: 0 in 0.603s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:47 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a Apr 24 19:21:47 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:47 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f" returned: 0 in 0.634s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[541c8311-21b3-455b-8583-2292ff592e7e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:47 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f Apr 24 19:21:47 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:48 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-9b4e76e0-748b-435c-a7ae-af386149aa6a" returned: 0 in 0.514s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-9b4e76e0-748b-435c-a7ae-af386149aa6a" released by "delete_volume" :: held 1.186s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Acquiring lock "cinder-a9d9e828-1780-4b19-9268-a2e5a45f681a-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Lock "cinder-a9d9e828-1780-4b19-9268-a2e5a45f681a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:48 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Acquiring lock "cinder-quobyte-a9d9e828-1780-4b19-9268-a2e5a45f681a" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f" returned: 0 in 0.588s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.fb217f37-e3c2-4ee5-8975-17d0b9040ff650_3ibpj.img {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Created reservations ['8f4a1492-8abf-4e6a-baad-e8506a2073eb', '09e9e76f-12ef-4693-8a77-5b414dddd789', 'af3122c1-f8d3-4064-bcaf-c10d80a52c8d', '18bbc50a-edfe-4520-bff6-59f551e4267e'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Lock "cinder-quobyte-a9d9e828-1780-4b19-9268-a2e5a45f681a" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:48 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.fb217f37-e3c2-4ee5-8975-17d0b9040ff650_3ibpj.img Apr 24 19:21:48 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f94553-e27e-4237-86cf-4a62dd925c44]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:48 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:21:48 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a Apr 24 19:21:48 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:48 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:49 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.568s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:49 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:49 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Deleted volume successfully. Apr 24 19:21:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-61b68dd2-e401-4e1b-80b7-a0535e9d86c9 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-9b4e76e0-748b-435c-a7ae-af386149aa6a-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:49 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a" returned: 0 in 0.734s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:49 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a Apr 24 19:21:49 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-10de2611-fb84-4ba1-be4e-204e4e550670-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-10de2611-fb84-4ba1-be4e-204e4e550670-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-quobyte-10de2611-fb84-4ba1-be4e-204e4e550670" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-10de2611-fb84-4ba1-be4e-204e4e550670" acquired by "delete_volume" :: waited 0.059s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:49 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d651778-17ae-4ae1-80ce-d563d0ce8edd]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:49 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670 Apr 24 19:21:49 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:50 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a9d9e828-1780-4b19-9268-a2e5a45f681a" returned: 0 in 1.236s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Lock "cinder-quobyte-a9d9e828-1780-4b19-9268-a2e5a45f681a" released by "delete_volume" :: held 2.023s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:50 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Created reservations ['0458b12d-7956-4375-88ce-7c7678b65453', '4995c233-a75d-46c7-a8c3-0dd87f468039', '213b8c8b-0a4b-42ee-86f2-b7ef43dc407f', 'd8333d2b-c13d-42a3-b002-c092c64c63c1'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:50 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670" returned: 0 in 1.216s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:50 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:21:50 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:50 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670 Apr 24 19:21:50 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:52 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.534s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:52 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Deleted volume successfully. Apr 24 19:21:52 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10de2611-fb84-4ba1-be4e-204e4e550670" returned: 0 in 1.551s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bdff885-41c3-4e77-b022-854b089e6e96 tempest-VolumesCloneNegativeTest-116288146 None] Lock "cinder-a9d9e828-1780-4b19-9268-a2e5a45f681a-delete_volume" released by "delete_volume" :: held 4.077s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-10de2611-fb84-4ba1-be4e-204e4e550670" released by "delete_volume" :: held 2.919s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Created reservations ['c420b6b5-96e7-48fd-bf3b-c7350b177688', 'e96846f0-6279-4172-89ec-1be3a6a539e7', 'dc2249e4-d5f3-44b6-a0f3-5a4cbfe120ca', '98c5e847-6435-4c65-8219-672ac39431c2'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:52 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:21:52 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-d71a8b2e-0069-42fc-89e0-f3603f57901e-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Lock "cinder-d71a8b2e-0069-42fc-89e0-f3603f57901e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Acquiring lock "cinder-quobyte-d71a8b2e-0069-42fc-89e0-f3603f57901e" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:21:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-d71a8b2e-0069-42fc-89e0-f3603f57901e" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:21:53 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c15c3fd-dab8-4be8-aa78-ed2cec8f1a3e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:53 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e Apr 24 19:21:53 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:54 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.587s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:54 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:54 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Deleted volume successfully. Apr 24 19:21:54 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f947ac8e-54f4-48c7-8b38-14f802f1adc4 tempest-VolumeDependencyTests-238870211 None] Lock "cinder-10de2611-fb84-4ba1-be4e-204e4e550670-delete_volume" released by "delete_volume" :: held 4.966s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.fb217f37-e3c2-4ee5-8975-17d0b9040ff650_3ibpj.img" returned: 0 in 5.920s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:54 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cb209a-efa6-4fb4-9fe4-1fb20b43eb2f]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:21:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:54 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f Apr 24 19:21:54 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:54 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e" returned: 0 in 1.107s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:54 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e Apr 24 19:21:54 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:55 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f" returned: 0 in 0.814s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.fb217f37-e3c2-4ee5-8975-17d0b9040ff650_3ibpj.img {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:21:55 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] Converted 1024.00 MB image at 172.93 MB/s Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] fb217f37-e3c2-4ee5-8975-17d0b9040ff6 was raw, no need to convert to raw {{(pid=82057) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 24 19:21:55 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d71a8b2e-0069-42fc-89e0-f3603f57901e" returned: 0 in 0.640s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Lock "cinder-quobyte-d71a8b2e-0069-42fc-89e0-f3603f57901e" released by "delete_volume" :: held 1.868s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Created reservations ['02bd3286-21fe-4f7d-9621-dce291e8c488', 'e3c9588a-7c29-4d17-a0e7-cc4b08101abc', '1d027104-4f8c-4eb2-a383-b0822d5fdce3', 'f4a0b7f1-c614-4580-82f0-1fa37673e669'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:55 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:21:55 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:56 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.674s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:21:56 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Deleted volume successfully. Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-bbaaa38b-30a8-4475-92d6-793e6fe8a27e tempest-VolumeDependencyTests-238870211 None] Lock "cinder-d71a8b2e-0069-42fc-89e0-f3603f57901e-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (c3d75305-a8bc-445e-9d99-8f78e7d56aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9105db-36b5-4824-96b4-f9c43cebf88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a9105db-36b5-4824-96b4-f9c43cebf88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1446924285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68f41ec-f190-47bc-8aed-30c169b0cc96,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:56Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b96fa5f-d2e7-4389-9843-49812ad112f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b96fa5f-d2e7-4389-9843-49812ad112f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b0479f-65f7-43bc-a2e2-0c6de2b526da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b0479f-65f7-43bc-a2e2-0c6de2b526da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68f41ec-f190-47bc-8aed-30c169b0cc96', 'volume_name': 'volume-f68f41ec-f190-47bc-8aed-30c169b0cc96', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a339c2ac-ebfd-4539-affc-04ff9887a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a339c2ac-ebfd-4539-affc-04ff9887a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b50e133-66e8-4b82-a372-0dea8b62266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:21:56 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Volume f68f41ec-f190-47bc-8aed-30c169b0cc96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68f41ec-f190-47bc-8aed-30c169b0cc96', 'volume_size': 1} Apr 24 19:21:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:21:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:21:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:21:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:21:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:21:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:21:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:21:58 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:21:58 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:21:58 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 24 19:21:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.470s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:21:58 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:06 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:UPDATE=71,cinder:INSERT=17,cinder:DELETE=6,cinder:SELECT=43 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:22:06 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:UPDATE=34,cinder:SELECT=33,cinder:INSERT=8,cinder:DELETE=2 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.358s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] Uploaded volume to glance image-id: fb217f37-e3c2-4ee5-8975-17d0b9040ff6. {{(pid=82057) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.972s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1446924285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68f41ec-f190-47bc-8aed-30c169b0cc96,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:21:56Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Creating volume f68f41ec-f190-47bc-8aed-30c169b0cc96 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:12 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:22:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:12 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96 1073741824 Apr 24 19:22:12 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:12 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-35d311b6-ace5-4e87-b416-5a90f0d5f3ae tempest-VolumesActionsTest-999936458 None] Copy volume to image completed successfully. Apr 24 19:22:13 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96 1073741824" returned: 0 in 0.708s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:13 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96 Apr 24 19:22:13 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:13 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96" returned: 0 in 0.500s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:22:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b50e133-66e8-4b82-a372-0dea8b62266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68f41ec-f190-47bc-8aed-30c169b0cc96', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67834232-8afb-4c4d-9b67-58dcdf675263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:13 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Volume volume-f68f41ec-f190-47bc-8aed-30c169b0cc96 (f68f41ec-f190-47bc-8aed-30c169b0cc96): created successfully Apr 24 19:22:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67834232-8afb-4c4d-9b67-58dcdf675263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (c3d75305-a8bc-445e-9d99-8f78e7d56aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:13 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4652da65-2b88-4a9a-a94f-96045c512972 tempest-VolumesGetTest-2015269625 None] Created volume successfully. Apr 24 19:22:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:14 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b53e0b2-7b4e-4c77-8c63-7877e367da5d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:14 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f Apr 24 19:22:14 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:14 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f" returned: 0 in 0.598s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:14 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb38f3aa-e1fc-4637-8a19-111538a61e0b]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:15 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f Apr 24 19:22:15 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (aa4c7e45-5e34-428c-9d1e-ed965b40fa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fa367e-0e0a-4582-b5c0-3d80254ff3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fa367e-0e0a-4582-b5c0-3d80254ff3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-271273955',display_name='tempest-VolumesGetTest-Volume-218776602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cf23db-9d7d-4fcf-ab60-379f2f3e71c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:15Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff07e47-fd47-4db1-85a0-237133e5585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff07e47-fd47-4db1-85a0-237133e5585b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1be61ff-ac80-4ac3-bb00-e7e96238dd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1be61ff-ac80-4ac3-bb00-e7e96238dd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84cf23db-9d7d-4fcf-ab60-379f2f3e71c0', 'volume_name': 'volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf03b18-ca4c-4059-a58f-cd95f658a7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf03b18-ca4c-4059-a58f-cd95f658a7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2945e2-ccca-4933-aafc-8c93093a7c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:15 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Volume 84cf23db-9d7d-4fcf-ab60-379f2f3e71c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0', 'volume_size': 1} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:15 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f" returned: 0 in 0.656s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:15 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img Apr 24 19:22:15 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:20 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img" returned: 0 in 4.750s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:20 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3da8451-e7f5-47f9-8247-a7f542a5347b]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:20 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f Apr 24 19:22:20 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:21 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f" returned: 0 in 0.681s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:21 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:22:21 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Converted 1024.00 MB image at 215.52 MB/s Apr 24 19:22:21 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] d49eb52d-0f43-440f-92da-0a75acf114f3 was raw, converting to qcow2 {{(pid=82057) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 24 19:22:21 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e24d53-749a-490b-b435-4104e4ffd32d]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:21 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img Apr 24 19:22:21 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:21 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img" returned: 0 in 0.583s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:21 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img Apr 24 19:22:21 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:22 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img" returned: 1 in 0.639s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:22:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img /opt/stack/data/cinder/conversion/vol_upload_dx6hrg98 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:22 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img /opt/stack/data/cinder/conversion/vol_upload_dx6hrg98 Apr 24 19:22:22 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:22 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img /opt/stack/data/cinder/conversion/vol_upload_dx6hrg98" returned: 0 in 0.534s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:22 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Image conversion details: src /opt/stack/data/cinder/conversion/92582c0b-6e7e-4963-933e-2656aaeb3f6f.temp_image.d49eb52d-0f43-440f-92da-0a75acf114f3wp4xc_qr.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_dx6hrg98 {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:22:22 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 24 19:22:22 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb5efa7-3dd4-40cf-b790-da0106a18ed1]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dx6hrg98 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:22 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dx6hrg98 Apr 24 19:22:22 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:23 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_dx6hrg98" returned: 0 in 0.646s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.749s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Uploaded volume to glance image-id: d49eb52d-0f43-440f-92da-0a75acf114f3. {{(pid=82057) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.730s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-271273955',display_name='tempest-VolumesGetTest-Volume-218776602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cf23db-9d7d-4fcf-ab60-379f2f3e71c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:15Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Creating volume 84cf23db-9d7d-4fcf-ab60-379f2f3e71c0 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:25 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:25 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-a65b834c-e02e-4f1b-a80b-8e812c9c3e03 tempest-VolumesActionsTest-999936458 None] Copy volume to image completed successfully. Apr 24 19:22:25 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0 1073741824 Apr 24 19:22:25 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:22:25 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0 1073741824" returned: 0 in 0.774s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:25 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0 Apr 24 19:22:25 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:26 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0" returned: 0 in 0.572s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2945e2-ccca-4933-aafc-8c93093a7c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5eddfbf-f396-4ab8-8a12-13662572a0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Acquiring lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:26 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Volume volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0 (84cf23db-9d7d-4fcf-ab60-379f2f3e71c0): created successfully Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5eddfbf-f396-4ab8-8a12-13662572a0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (aa4c7e45-5e34-428c-9d1e-ed965b40fa49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:26 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-42f4b9ff-6bad-456a-87ef-e6896645ef55 tempest-VolumesGetTest-2015269625 None] Created volume successfully. Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Acquiring lock "cinder-quobyte-92582c0b-6e7e-4963-933e-2656aaeb3f6f" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Lock "cinder-quobyte-92582c0b-6e7e-4963-933e-2656aaeb3f6f" acquired by "delete_volume" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[1761f269-ccb6-4cff-8541-d95e64affc3f]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:26 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f Apr 24 19:22:26 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:27 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f" returned: 0 in 0.674s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:27 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f Apr 24 19:22:27 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Lock "cinder-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-quobyte-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0" acquired by "delete_volume" :: waited 0.028s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:27 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00fabe3-51ce-4157-9e56-141c526bdc28]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:27 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0 Apr 24 19:22:27 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:28 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-92582c0b-6e7e-4963-933e-2656aaeb3f6f" returned: 0 in 0.710s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Lock "cinder-quobyte-92582c0b-6e7e-4963-933e-2656aaeb3f6f" released by "delete_volume" :: held 1.424s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Created reservations ['0145a8df-63b7-43df-b748-ceae825d2f3c', '199978ce-b232-4916-b736-b2de75ce2088', 'eba839a5-cc46-4cf8-a293-6c22cf5758ef', '87bea997-3fb8-4129-b184-21938164e184'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:28 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:22:28 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:28 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0" returned: 0 in 0.651s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:28 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0 Apr 24 19:22:28 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:28 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.579s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Deleted volume successfully. Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-8bff8d17-695c-4adb-b33e-e819b4735fa2 tempest-VolumesActionsTest-999936458 None] Lock "cinder-92582c0b-6e7e-4963-933e-2656aaeb3f6f-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:28 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0" returned: 0 in 0.580s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0" released by "delete_volume" :: held 1.288s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:29 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Created reservations ['218a2c19-7846-4f36-9929-55ef20dc86c6', '46684afe-7e65-47ef-8a44-d1d2a6b72d4b', '9828ce8d-714e-4ee8-8eb9-d79f0ca077b5', '09962968-52fb-408f-86f8-c637f5379bc9'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:29 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:22:29 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:29 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.583s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:29 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:29 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Deleted volume successfully. Apr 24 19:22:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b333c909-faa5-4a5f-9f17-47e7a756951c tempest-VolumesGetTest-2015269625 None] Lock "cinder-84cf23db-9d7d-4fcf-ab60-379f2f3e71c0-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-f68f41ec-f190-47bc-8aed-30c169b0cc96-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Lock "cinder-f68f41ec-f190-47bc-8aed-30c169b0cc96-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-quobyte-f68f41ec-f190-47bc-8aed-30c169b0cc96" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-f68f41ec-f190-47bc-8aed-30c169b0cc96" acquired by "delete_volume" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:30 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83de227-e61b-46bc-ac91-d06ba249b8b4]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:30 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96 Apr 24 19:22:30 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:30 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96" returned: 0 in 0.665s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:30 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96 Apr 24 19:22:30 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:31 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f68f41ec-f190-47bc-8aed-30c169b0cc96" returned: 0 in 0.613s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-f68f41ec-f190-47bc-8aed-30c169b0cc96" released by "delete_volume" :: held 1.326s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:31 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Created reservations ['355c3647-282a-44af-93f1-08073d319cbd', '74691e7a-574a-4eab-9b25-6df7df20535e', '0f5bdb23-8cff-466a-8937-e092bd938c5f', '5d9002d0-1a28-4749-b753-fa7207400dc1'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:31 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:31 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:31 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:22:31 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:32 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.654s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:32 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Deleted volume successfully. Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-2c72bf09-1311-4acf-9218-66d2961fc0ac tempest-VolumesGetTest-2015269625 None] Lock "cinder-f68f41ec-f190-47bc-8aed-30c169b0cc96-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (a9d1917d-a1cd-4508-9ca4-e121be1427a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096610f4-7e30-4448-9637-5e210e3acdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096610f4-7e30-4448-9637-5e210e3acdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-68259332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e98e05a-27b9-4af0-91ad-4a4939da92f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:33Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd91a5ab-9c94-4a14-8d3b-2ce4a6639573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd91a5ab-9c94-4a14-8d3b-2ce4a6639573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6a4193-515f-488a-bb58-4e139d2df644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6a4193-515f-488a-bb58-4e139d2df644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e98e05a-27b9-4af0-91ad-4a4939da92f5', 'volume_name': 'volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea36fe89-c0f8-40ea-834e-f57aa9e4b0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea36fe89-c0f8-40ea-834e-f57aa9e4b0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163e4108-cda7-40b1-9789-f7472f8822c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:32 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Volume 3e98e05a-27b9-4af0-91ad-4a4939da92f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5', 'volume_size': 1} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-68259332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e98e05a-27b9-4af0-91ad-4a4939da92f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:33Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Creating volume 3e98e05a-27b9-4af0-91ad-4a4939da92f5 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:32 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:22:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:32 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 1073741824 Apr 24 19:22:32 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:33 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 1073741824" returned: 0 in 0.828s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:33 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 Apr 24 19:22:33 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:34 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5" returned: 0 in 0.647s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:34 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:22:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163e4108-cda7-40b1-9789-f7472f8822c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dd0f9f-c989-4aa7-a610-7ebda24fd3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:34 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Volume volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 (3e98e05a-27b9-4af0-91ad-4a4939da92f5): created successfully Apr 24 19:22:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dd0f9f-c989-4aa7-a610-7ebda24fd3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:34 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (a9d1917d-a1cd-4508-9ca4-e121be1427a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:34 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-fa25ae49-9869-44d0-a46a-807cbfa11538 tempest-VolumesGetTest-2015269625 None] Created volume successfully. Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (2542da8e-e6d7-4495-bc4c-b0aa47eb0f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30bc3ede-5c1d-49cc-bddf-f69054e09496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30bc3ede-5c1d-49cc-bddf-f69054e09496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-165700545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45a37c6-a97d-4719-9bfc-1e446752e93c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3e98e05a-27b9-4af0-91ad-4a4939da92f5,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:36Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2990535c-afb2-467f-ab15-4a6ea5c854cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2990535c-afb2-467f-ab15-4a6ea5c854cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855ed5aa-d391-4d54-a1ab-fc91e3c707b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855ed5aa-d391-4d54-a1ab-fc91e3c707b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f45a37c6-a97d-4719-9bfc-1e446752e93c', 'volume_name': 'volume-f45a37c6-a97d-4719-9bfc-1e446752e93c', 'volume_size': 1, 'source_volid': '3e98e05a-27b9-4af0-91ad-4a4939da92f5', 'source_volstatus': 'available'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e507d3fe-4cbf-44c7-888b-da3b6a1b28cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e507d3fe-4cbf-44c7-888b-da3b6a1b28cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62dcfa24-784a-44bc-b890-132a9cd97682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:35 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Volume f45a37c6-a97d-4719-9bfc-1e446752e93c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f45a37c6-a97d-4719-9bfc-1e446752e93c', 'volume_size': 1, 'source_volid': '3e98e05a-27b9-4af0-91ad-4a4939da92f5', 'source_volstatus': 'available'} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:35 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Cloning volume 3e98e05a-27b9-4af0-91ad-4a4939da92f5 to volume f45a37c6-a97d-4719-9bfc-1e446752e93c Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Creating offline snapshot a5854238-08ba-4f96-880f-2a1eade16518 of volume 3e98e05a-27b9-4af0-91ad-4a4939da92f5 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7bc905-b480-4b50-802c-e05d908acc35]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:36 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 Apr 24 19:22:36 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:36 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5" returned: 0 in 0.668s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:36 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 1G Apr 24 19:22:36 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:37 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 1G" returned: 0 in 0.782s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:37 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 Apr 24 19:22:37 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:37 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518" returned: 0 in 0.608s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:37 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 is being set with open permissions: ugo+rw Apr 24 19:22:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:37 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 Apr 24 19:22:37 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:38 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518" returned: 0 in 0.546s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:38 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.info Apr 24 19:22:38 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:39 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.info" returned: 0 in 0.536s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:39 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.info is being set with open permissions: ugo+rw Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:39 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.info Apr 24 19:22:39 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:39 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.info" returned: 0 in 0.528s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-quobyte-f45a37c6-a97d-4719-9bfc-1e446752e93c" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-f45a37c6-a97d-4719-9bfc-1e446752e93c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] snapshot: a5854238-08ba-4f96-880f-2a1eade16518, volume: f45a37c6-a97d-4719-9bfc-1e446752e93c, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0fa723-bcd8-460a-9d74-ed8481f6afb5]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:39 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 Apr 24 19:22:39 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:40 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518" returned: 0 in 0.619s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:22:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:22:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:22:40 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28be870-7f89-4242-9616-210b8a136ef1]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:40 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 Apr 24 19:22:40 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:41 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5" returned: 0 in 0.700s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:41 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:22:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:41 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c Apr 24 19:22:41 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:45 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=21,cinder:UPDATE=30,cinder:INSERT=11,cinder:DELETE=1 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:22:47 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c" returned: 0 in 6.571s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[5622791e-2aa3-459b-a3c0-447f3080d65d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:47 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 Apr 24 19:22:47 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Flow 'volume_create_manager' (f339a664-2de3-4586-826f-35f67e9d154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6883e6f-f73d-4b3d-a043-f4a4fc901472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6883e6f-f73d-4b3d-a043-f4a4fc901472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1677503752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ce9449-9e92-4f1f-95fe-21c801ec0ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea3fd5fbe6e409baf9a7308d1976867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:48Z,use_quota=True,user_id='1a15a29619964ec4a05890625adce32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81e50be-cd06-43d8-92fa-8c285aca62f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81e50be-cd06-43d8-92fa-8c285aca62f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773b0102-50ee-48d9-8932-ae8e03fa609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773b0102-50ee-48d9-8932-ae8e03fa609b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58ce9449-9e92-4f1f-95fe-21c801ec0ffa', 'volume_name': 'volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94977828-d7df-4084-bff0-b3c749b65ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94977828-d7df-4084-bff0-b3c749b65ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38084395-0d50-4359-9699-bf5922415941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:47 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume 58ce9449-9e92-4f1f-95fe-21c801ec0ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa', 'volume_size': 1} Apr 24 19:22:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:48 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5" returned: 0 in 0.777s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:48 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:22:48 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Converted 1024.00 MB image at 155.79 MB/s Apr 24 19:22:48 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c is being set with open permissions: ugo+rw Apr 24 19:22:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:48 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c Apr 24 19:22:48 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:48 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c" returned: 0 in 0.453s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-f45a37c6-a97d-4719-9bfc-1e446752e93c" released by "_copy_volume_from_snapshot" :: held 9.208s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-quobyte-a5854238-08ba-4f96-880f-2a1eade16518" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-a5854238-08ba-4f96-880f-2a1eade16518" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Deleting offline snapshot a5854238-08ba-4f96-880f-2a1eade16518 of volume 3e98e05a-27b9-4af0-91ad-4a4939da92f5 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:22:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] snapshot_file for this snap is: volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:22:48 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf1e9fb-c02b-46cc-bfcc-4f05af3c2a0c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:49 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 Apr 24 19:22:49 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:49 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518" returned: 0 in 0.508s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:22:49 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a079cd-ea68-41e9-8f42-4408bd1c14b6]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:49 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 Apr 24 19:22:49 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:50 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5" returned: 0 in 0.551s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:50 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 Apr 24 19:22:50 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:50 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518" returned: 0 in 0.578s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:50 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518 Apr 24 19:22:50 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:51 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5.a5854238-08ba-4f96-880f-2a1eade16518" returned: 0 in 0.451s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-a5854238-08ba-4f96-880f-2a1eade16518" released by "_delete_snapshot" :: held 2.184s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.298s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.129s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1677503752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ce9449-9e92-4f1f-95fe-21c801ec0ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea3fd5fbe6e409baf9a7308d1976867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:48Z,use_quota=True,user_id='1a15a29619964ec4a05890625adce32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Creating volume 58ce9449-9e92-4f1f-95fe-21c801ec0ffa {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:51 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:51 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa 1073741824 Apr 24 19:22:51 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62dcfa24-784a-44bc-b890-132a9cd97682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45a37c6-a97d-4719-9bfc-1e446752e93c', 'volume_size': 1, 'source_volid': '3e98e05a-27b9-4af0-91ad-4a4939da92f5', 'source_volstatus': 'available'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabcfe37-c866-4d32-a365-5bbd1ea07d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:51 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Volume volume-f45a37c6-a97d-4719-9bfc-1e446752e93c (f45a37c6-a97d-4719-9bfc-1e446752e93c): created successfully Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabcfe37-c866-4d32-a365-5bbd1ea07d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (2542da8e-e6d7-4495-bc4c-b0aa47eb0f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:51 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0ac73d4e-05e1-44a0-a1d0-f3ffe1394269 tempest-VolumesGetTest-2015269625 None] Created volume successfully. Apr 24 19:22:51 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa 1073741824" returned: 0 in 0.638s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:51 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa Apr 24 19:22:51 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:52 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa" returned: 0 in 0.485s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38084395-0d50-4359-9699-bf5922415941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929be0c9-823c-428f-a37b-c86e10fc8a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:52 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa (58ce9449-9e92-4f1f-95fe-21c801ec0ffa): created successfully Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929be0c9-823c-428f-a37b-c86e10fc8a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Flow 'volume_create_manager' (f339a664-2de3-4586-826f-35f67e9d154d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:52 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-2bdc1825-c4bc-4ea4-8853-0c37665f7440 tempest-VolumesSnapshotTestJSON-2048280815 None] Created volume successfully. Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (68607140-109d-4b15-a258-b5d92a814aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367509d9-8503-4a13-aafa-5d36715a1125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367509d9-8503-4a13-aafa-5d36715a1125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1459754398',display_name='tempest-VolumesGetTest-Volume-2011401148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f494ee-2737-481c-974d-11deeb94392d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:53Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49957d1-73f9-4ecf-a850-61a3b8f81c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e49957d1-73f9-4ecf-a850-61a3b8f81c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e85506e-3eaf-4eea-ad1c-4e798fbd2928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e85506e-3eaf-4eea-ad1c-4e798fbd2928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f494ee-2737-481c-974d-11deeb94392d', 'volume_name': 'volume-51f494ee-2737-481c-974d-11deeb94392d', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8472691-8329-42e3-9ba8-aba341a8b7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8472691-8329-42e3-9ba8-aba341a8b7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98ab862-3ac4-42f4-ac85-7d9ffd63d393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:52 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Volume 51f494ee-2737-481c-974d-11deeb94392d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f494ee-2737-481c-974d-11deeb94392d', 'volume_size': 1} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:22:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1459754398',display_name='tempest-VolumesGetTest-Volume-2011401148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f494ee-2737-481c-974d-11deeb94392d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:22:53Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Creating volume 51f494ee-2737-481c-974d-11deeb94392d {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:22:52 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:22:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:52 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d 1073741824 Apr 24 19:22:52 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:53 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d 1073741824" returned: 0 in 0.858s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:53 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d Apr 24 19:22:53 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:54 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d" returned: 0 in 0.638s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:22:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.904s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98ab862-3ac4-42f4-ac85-7d9ffd63d393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f494ee-2737-481c-974d-11deeb94392d', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e680f055-3ffd-4a4a-a596-d52876c8b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:22:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] Creating offline snapshot 843e78e1-64ac-4e77-b0bf-c4f62d4e4cac of volume 58ce9449-9e92-4f1f-95fe-21c801ec0ffa {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:22:54 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Volume volume-51f494ee-2737-481c-974d-11deeb94392d (51f494ee-2737-481c-974d-11deeb94392d): created successfully Apr 24 19:22:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e680f055-3ffd-4a4a-a596-d52876c8b77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:22:54 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (68607140-109d-4b15-a258-b5d92a814aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:22:54 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e42714-5d66-46e2-8d90-95f8bc3b2feb]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:54 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-ee7ce428-b570-44ca-be77-9fd6b0c7e9e8 tempest-VolumesGetTest-2015269625 None] Created volume successfully. Apr 24 19:22:54 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa Apr 24 19:22:54 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-51f494ee-2737-481c-974d-11deeb94392d-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Lock "cinder-51f494ee-2737-481c-974d-11deeb94392d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:55 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa" returned: 0 in 0.709s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:55 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac 1G Apr 24 19:22:55 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-quobyte-51f494ee-2737-481c-974d-11deeb94392d" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-51f494ee-2737-481c-974d-11deeb94392d" acquired by "delete_volume" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:55 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba52e9-8a2d-4a62-a5a7-47eb0a90525a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:55 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d Apr 24 19:22:55 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:55 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac 1G" returned: 0 in 0.704s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:56 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac Apr 24 19:22:56 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:56 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d" returned: 0 in 0.651s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:56 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d Apr 24 19:22:56 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:56 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac" returned: 0 in 0.553s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:56 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac is being set with open permissions: ugo+rw Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:56 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac Apr 24 19:22:56 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:56 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-51f494ee-2737-481c-974d-11deeb94392d" returned: 0 in 0.563s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-51f494ee-2737-481c-974d-11deeb94392d" released by "delete_volume" :: held 1.262s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Created reservations ['202f50de-6c72-4674-b94e-d97e5a3bc2e4', 'e1ea4401-e0a6-457a-acd0-299e7855b8be', '47977363-b1e3-4f25-8974-e4478380edbc', '0ae53fc8-d286-4361-a18f-9e4755baef8c'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:56 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:22:56 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:57 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac" returned: 0 in 0.549s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:57 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.info Apr 24 19:22:57 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:57 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.531s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:57 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Deleted volume successfully. Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-92649d45-acb4-4acd-b8c1-d246d4acb9cf tempest-VolumesGetTest-2015269625 None] Lock "cinder-51f494ee-2737-481c-974d-11deeb94392d-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-f45a37c6-a97d-4719-9bfc-1e446752e93c-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Lock "cinder-f45a37c6-a97d-4719-9bfc-1e446752e93c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-quobyte-f45a37c6-a97d-4719-9bfc-1e446752e93c" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-f45a37c6-a97d-4719-9bfc-1e446752e93c" acquired by "delete_volume" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[077d2fdb-6530-4838-acad-34ea83e2a822]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:57 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.info" returned: 0 in 0.657s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:57 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.info is being set with open permissions: ugo+rw Apr 24 19:22:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:57 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c Apr 24 19:22:57 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:57 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.info Apr 24 19:22:57 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:58 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.info" returned: 0 in 0.465s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.783s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:58 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-61051a64-83d0-41d1-894b-ca66e40c1206 tempest-VolumesSnapshotTestJSON-2048280815 None] Create snapshot completed successfully Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c" returned: 0 in 0.683s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:58 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:22:58 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:58 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c Apr 24 19:22:58 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:58 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.548s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:58 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f45a37c6-a97d-4719-9bfc-1e446752e93c" returned: 0 in 0.557s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:58 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-f45a37c6-a97d-4719-9bfc-1e446752e93c" released by "delete_volume" :: held 1.319s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Created reservations ['f1adfe2f-d4ec-4c0a-9ff8-88fa5cc6528f', 'b8628754-d3c4-474f-adf1-63779b22f513', '4a99033d-210d-49fb-a2a8-8c9b3466ebbb', '327612d6-adbd-40de-8427-8415cb1fe659'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-843e78e1-64ac-4e77-b0bf-c4f62d4e4cac-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-843e78e1-64ac-4e77-b0bf-c4f62d4e4cac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:59 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:22:59 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-58ce9449-9e92-4f1f-95fe-21c801ec0ffa" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-58ce9449-9e92-4f1f-95fe-21c801ec0ffa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-843e78e1-64ac-4e77-b0bf-c4f62d4e4cac" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-843e78e1-64ac-4e77-b0bf-c4f62d4e4cac" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Deleting offline snapshot 843e78e1-64ac-4e77-b0bf-c4f62d4e4cac of volume 58ce9449-9e92-4f1f-95fe-21c801ec0ffa {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] snapshot_file for this snap is: volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09affad-bf62-4e10-8a6a-e209c8720492]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:59 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac Apr 24 19:22:59 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:22:59 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.501s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:22:59 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Deleted volume successfully. Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-32ed707a-d571-4c85-98f7-37f8723e85a3 tempest-VolumesGetTest-2015269625 None] Lock "cinder-f45a37c6-a97d-4719-9bfc-1e446752e93c-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:22:59 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac" returned: 0 in 0.589s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ff47f0-f63f-4c8b-8d90-d4cc45ea7b55]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-3e98e05a-27b9-4af0-91ad-4a4939da92f5-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Lock "cinder-3e98e05a-27b9-4af0-91ad-4a4939da92f5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-quobyte-3e98e05a-27b9-4af0-91ad-4a4939da92f5" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:22:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-3e98e05a-27b9-4af0-91ad-4a4939da92f5" acquired by "delete_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:22:59 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa Apr 24 19:22:59 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:00 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc909e9a-111c-4e89-8373-a3ee3496521c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:00 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 Apr 24 19:23:00 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:00 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa" returned: 0 in 0.653s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:00 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac Apr 24 19:23:00 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:00 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5" returned: 0 in 0.615s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:00 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5 Apr 24 19:23:00 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:01 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac" returned: 0 in 0.642s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:01 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac Apr 24 19:23:01 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:01 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e98e05a-27b9-4af0-91ad-4a4939da92f5" returned: 0 in 0.552s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-3e98e05a-27b9-4af0-91ad-4a4939da92f5" released by "delete_volume" :: held 1.232s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Created reservations ['08f6ae8d-31a4-41fb-9724-178a498facfd', '82369ee6-e797-4d0a-a2a2-d120877adc2c', '41d7cd83-9c03-4837-bc06-e031bfedfdfd', '3dc51687-e0c9-4816-a454-3a36b5c77124'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:01 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:23:01 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:01 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa.843e78e1-64ac-4e77-b0bf-c4f62d4e4cac" returned: 0 in 0.540s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-843e78e1-64ac-4e77-b0bf-c4f62d4e4cac" released by "_delete_snapshot" :: held 2.562s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-58ce9449-9e92-4f1f-95fe-21c801ec0ffa" released by "delete_snapshot" :: held 2.584s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Created reservations ['bd5c6dbc-fb88-4dc4-b8e5-8a94714bec2b', 'a320c1cd-d4a6-4173-b526-09cdd26f3018', '5a7facb0-9ec2-4681-ab60-d5658814f291', '91b9de98-f71b-46f1-af20-4209aa4d55e1'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Delete snapshot completed successfully. Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fb1acc21-49f2-4e86-aaf1-ca6f7ef6e710 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-843e78e1-64ac-4e77-b0bf-c4f62d4e4cac-delete_snapshot" released by "delete_snapshot" :: held 2.797s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:01 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.540s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Deleted volume successfully. Apr 24 19:23:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-26bc5cbc-44bb-4c8b-88e1-3f4d24dea3ce tempest-VolumesGetTest-2015269625 None] Lock "cinder-3e98e05a-27b9-4af0-91ad-4a4939da92f5-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Flow 'volume_create_manager' (7f5cd6f3-0ab0-40be-86f3-845c4cca59eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ce8e63-ed9d-4aec-be35-d7b567fd75bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ce8e63-ed9d-4aec-be35-d7b567fd75bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-853401094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9555bc-b243-4bf3-b674-2bcb73f80e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea3fd5fbe6e409baf9a7308d1976867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:03Z,use_quota=True,user_id='1a15a29619964ec4a05890625adce32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee208a2a-14dc-4bc1-be6e-3fbec60caf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee208a2a-14dc-4bc1-be6e-3fbec60caf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe1842f-9cec-4dbc-9c4b-977067b774f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe1842f-9cec-4dbc-9c4b-977067b774f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9555bc-b243-4bf3-b674-2bcb73f80e6b', 'volume_name': 'volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eef738-c734-4223-9156-aaf532731928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eef738-c734-4223-9156-aaf532731928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43712fc7-798b-4e8d-8f03-8cb3a4f5848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:02 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Volume 4e9555bc-b243-4bf3-b674-2bcb73f80e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b', 'volume_size': 1} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-853401094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9555bc-b243-4bf3-b674-2bcb73f80e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea3fd5fbe6e409baf9a7308d1976867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:03Z,use_quota=True,user_id='1a15a29619964ec4a05890625adce32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Creating volume 4e9555bc-b243-4bf3-b674-2bcb73f80e6b {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:02 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:02 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b 1073741824 Apr 24 19:23:02 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (3e7f73e9-5972-408f-adb6-d00319fa7a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46baa26f-b5a6-4575-8eeb-3739d2e40bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46baa26f-b5a6-4575-8eeb-3739d2e40bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1568881725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c739b1-cea3-41f3-b12c-67be3f810f45,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:03Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699bccbd-062a-4595-a776-10ae13f9f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699bccbd-062a-4595-a776-10ae13f9f60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bbfc04-97f1-49ee-bc79-41b49a7c4f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:02 devstack cinder-volume[82057]: DEBUG cinder.image.glance [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Creating Keystone auth plugin from conf {{(pid=82057) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 19:23:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bbfc04-97f1-49ee-bc79-41b49a7c4f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e4c739b1-cea3-41f3-b12c-67be3f810f45', 'volume_name': 'volume-e4c739b1-cea3-41f3-b12c-67be3f810f45', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38539749-2dcb-4b00-b1bd-a1845a5faddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38539749-2dcb-4b00-b1bd-a1845a5faddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f5466a-a61d-4a31-8aad-8bc8fd2ad90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:03 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Volume e4c739b1-cea3-41f3-b12c-67be3f810f45: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e4c739b1-cea3-41f3-b12c-67be3f810f45', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 19:23:03 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Trying to clone e4c739b1-cea3-41f3-b12c-67be3f810f45 from image 89fa23e1-262a-416b-b193-8f71185c7514 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]). {{(pid=82057) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 19:23:03 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b 1073741824" returned: 0 in 0.686s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:03 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b Apr 24 19:23:03 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:03 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 19:23:03 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Image download 20.69 MB at 20.69 MB/s Apr 24 19:23:03 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[10055ca4-9928-4519-90ee-88a884e595bb]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:03 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD Apr 24 19:23:03 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:04 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" returned: 0 in 0.567s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43712fc7-798b-4e8d-8f03-8cb3a4f5848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15569bad-494c-48dc-be8a-540172bb238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:04 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Volume volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b (4e9555bc-b243-4bf3-b674-2bcb73f80e6b): created successfully Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15569bad-494c-48dc-be8a-540172bb238e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Flow 'volume_create_manager' (7f5cd6f3-0ab0-40be-86f3-845c4cca59eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:04 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-20bca648-b1ee-48ff-ac43-0c41cfe0a84f tempest-VolumesSnapshotTestJSON-2048280815 None] Created volume successfully. Apr 24 19:23:04 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Temporary image 89fa23e1-262a-416b-b193-8f71185c7514 is fetched for user 87d62c69bc924aa5800a18317928fba8. {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9913072b-9821-4435-b954-20c38af203f9]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:04 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD Apr 24 19:23:04 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:04 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD" returned: 0 in 0.629s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1568881725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c739b1-cea3-41f3-b12c-67be3f810f45,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:03Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Creating volume e4c739b1-cea3-41f3-b12c-67be3f810f45 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:04 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:23:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:05 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 1073741824 Apr 24 19:23:05 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:05 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 1073741824" returned: 0 in 0.673s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:05 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 Apr 24 19:23:05 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:06 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45" returned: 0 in 0.518s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.158s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Attempting download of 89fa23e1-262a-416b-b193-8f71185c7514 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}])) to volume e4c739b1-cea3-41f3-b12c-67be3f810f45. {{(pid=82057) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] Creating offline snapshot 82f3770b-787b-472c-b8dd-437b83373c95 of volume 4e9555bc-b243-4bf3-b674-2bcb73f80e6b {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[94febd75-f6ee-403a-92e4-6f6e2154e690]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4677858-1045-4d9c-ad3c-15d0c04217e8]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_9ioup6r6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:06 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b Apr 24 19:23:06 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:06 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_9ioup6r6 Apr 24 19:23:06 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:06 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_9ioup6r6" returned: 0 in 0.548s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_9ioup6r6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:06 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" returned: 0 in 0.592s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:06 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 1G Apr 24 19:23:06 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:06 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_9ioup6r6 Apr 24 19:23:06 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:07 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_9ioup6r6" returned: 1 in 0.600s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fa23e1-262a-416b-b193-8f71185c7514_9ioup6r6' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:23:07 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[739265ca-5eb6-48a5-8805-3047f1a9e7c4]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:07 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 1G" returned: 0 in 0.673s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:07 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 Apr 24 19:23:07 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:07 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD Apr 24 19:23:07 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:08 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD" returned: 0 in 0.675s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:08 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] 89fa23e1-262a-416b-b193-8f71185c7514 was qcow2, converting to raw {{(pid=82057) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 19:23:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:08 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 Apr 24 19:23:08 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:08 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95" returned: 0 in 0.653s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:08 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 is being set with open permissions: ugo+rw Apr 24 19:23:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:08 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 Apr 24 19:23:08 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:08 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95" returned: 0 in 0.561s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:08 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=71,cinder:INSERT=22,cinder:UPDATE=87,cinder:DELETE=9 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:23:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:08 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.info Apr 24 19:23:08 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:09 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.info" returned: 0 in 0.652s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:09 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.info is being set with open permissions: ugo+rw Apr 24 19:23:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:09 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.info Apr 24 19:23:09 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:09 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45" returned: 0 in 1.727s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:09 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89fa23e1-262a-416b-b193-8f71185c7514_pg34ir3rdevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:23:09 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Converted 112.00 MB image at 64.77 MB/s Apr 24 19:23:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:09 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 1G Apr 24 19:23:09 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:10 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.info" returned: 0 in 0.570s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.838s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:10 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-b792c091-f462-46de-b964-d9662bf21cfe tempest-VolumesSnapshotTestJSON-2048280815 None] Create snapshot completed successfully Apr 24 19:23:10 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 1G" returned: 0 in 0.597s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b49daf-c5d2-427b-a548-ebc88e40b7e5]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:10 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 Apr 24 19:23:10 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Flow 'volume_create_manager' (11bfdcfe-02a7-4c81-a210-3e00dc21a2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea68d41-1034-47c5-9f80-d613540b271e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea68d41-1034-47c5-9f80-d613540b271e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1230599288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb65160-3858-4436-8dcc-5563e946739e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea3fd5fbe6e409baf9a7308d1976867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=82f3770b-787b-472c-b8dd-437b83373c95,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:11Z,use_quota=True,user_id='1a15a29619964ec4a05890625adce32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32872c9-1b05-4022-ab53-401130ee704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32872c9-1b05-4022-ab53-401130ee704b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d4a333-2618-4554-a91b-7335fd3d2713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d4a333-2618-4554-a91b-7335fd3d2713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bcb65160-3858-4436-8dcc-5563e946739e', 'volume_name': 'volume-bcb65160-3858-4436-8dcc-5563e946739e', 'volume_size': 2, 'snapshot_id': '82f3770b-787b-472c-b8dd-437b83373c95'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18511d0b-59bc-4f81-bea4-221da8487133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18511d0b-59bc-4f81-bea4-221da8487133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d27d85-223e-4afe-adba-e37c87ac076d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:10 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume bcb65160-3858-4436-8dcc-5563e946739e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bcb65160-3858-4436-8dcc-5563e946739e', 'volume_size': 2, 'snapshot_id': '82f3770b-787b-472c-b8dd-437b83373c95'} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-82f3770b-787b-472c-b8dd-437b83373c95-bcb65160-3858-4436-8dcc-5563e946739e" by "_create_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-82f3770b-787b-472c-b8dd-437b83373c95-bcb65160-3858-4436-8dcc-5563e946739e" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Creating volume bcb65160-3858-4436-8dcc-5563e946739e from snapshot 82f3770b-787b-472c-b8dd-437b83373c95 {{(pid=82057) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-bcb65160-3858-4436-8dcc-5563e946739e" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-bcb65160-3858-4436-8dcc-5563e946739e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] snapshot: 82f3770b-787b-472c-b8dd-437b83373c95, volume: bcb65160-3858-4436-8dcc-5563e946739e, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7c2ba7-b19f-4732-8d9a-e2e07fa29a11]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:11 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 Apr 24 19:23:11 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:11 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45" returned: 0 in 0.608s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:11 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 Apr 24 19:23:11 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:11 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95" returned: 0 in 0.608s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d03d48-a06c-483e-bd08-cd8c5529be84]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:11 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b Apr 24 19:23:11 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:11 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45" returned: 1 in 0.603s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Downloaded image 89fa23e1-262a-416b-b193-8f71185c7514 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}])) to volume e4c739b1-cea3-41f3-b12c-67be3f810f45 successfully. {{(pid=82057) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Temporary image 89fa23e1-262a-416b-b193-8f71185c7514 for user 87d62c69bc924aa5800a18317928fba8 is deleted. {{(pid=82057) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.volume_utils [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Marking volume e4c739b1-cea3-41f3-b12c-67be3f810f45 as bootable. {{(pid=82057) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Copying metadata from image 89fa23e1-262a-416b-b193-8f71185c7514 to e4c739b1-cea3-41f3-b12c-67be3f810f45. {{(pid=82057) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Creating volume glance metadata for volume e4c739b1-cea3-41f3-b12c-67be3f810f45 backed by image 89fa23e1-262a-416b-b193-8f71185c7514 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82057) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f5466a-a61d-4a31-8aad-8bc8fd2ad90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c739b1-cea3-41f3-b12c-67be3f810f45', 'volume_size': 1, 'image_id': '89fa23e1-262a-416b-b193-8f71185c7514', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fa23e1-262a-416b-b193-8f71185c7514', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e550385fcc9d473cb38d127472a3dfb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '89fa23e1-262a-416b-b193-8f71185c7514', 'created_at': datetime.datetime(2026, 4, 24, 17, 6, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 17, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fa23e1-262a-416b-b193-8f71185c7514/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5783e6f-426c-498d-8c90-0aa22da585d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:11 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Volume volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 (e4c739b1-cea3-41f3-b12c-67be3f810f45): created successfully Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5783e6f-426c-498d-8c90-0aa22da585d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (3e7f73e9-5972-408f-adb6-d00319fa7a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:11 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-243798bb-bdbe-4f83-9c21-4b4548882770 tempest-VolumesGetTest-2015269625 None] Created volume successfully. Apr 24 19:23:12 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" returned: 0 in 0.576s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:12 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:23:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:12 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e Apr 24 19:23:12 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (64f77a60-bfc3-41bc-9971-228bb872bb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24984bd-ddbc-4c77-a812-4e8e472c4bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24984bd-ddbc-4c77-a812-4e8e472c4bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1968463393',display_name='tempest-VolumesGetTest-Volume-1186418908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86993b93-dcee-4206-b24f-7f6ef90e3884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:13Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4475fd56-8fb2-47b6-b8f5-cf1de138c529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4475fd56-8fb2-47b6-b8f5-cf1de138c529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1b6976-3113-4240-8feb-7d34290ab5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1b6976-3113-4240-8feb-7d34290ab5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86993b93-dcee-4206-b24f-7f6ef90e3884', 'volume_name': 'volume-86993b93-dcee-4206-b24f-7f6ef90e3884', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0463fa-754e-42b8-aac7-2c58c8b6142a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0463fa-754e-42b8-aac7-2c58c8b6142a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9a5e02-9d42-445b-bef7-45ea2dc9a765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:13 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Volume 86993b93-dcee-4206-b24f-7f6ef90e3884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86993b93-dcee-4206-b24f-7f6ef90e3884', 'volume_size': 1} Apr 24 19:23:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:17 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e" returned: 0 in 4.886s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:17 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55fde8c-c2fb-4661-906d-3919afb65d6b]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:17 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b Apr 24 19:23:17 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:17 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" returned: 0 in 0.667s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:17 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:23:17 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Converted 1024.00 MB image at 209.53 MB/s Apr 24 19:23:17 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e is being set with open permissions: ugo+rw Apr 24 19:23:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:17 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e Apr 24 19:23:17 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:18 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e" returned: 0 in 0.429s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-bcb65160-3858-4436-8dcc-5563e946739e" released by "_copy_volume_from_snapshot" :: held 7.266s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-82f3770b-787b-472c-b8dd-437b83373c95-bcb65160-3858-4436-8dcc-5563e946739e" released by "_create_volume_from_snapshot" :: held 7.298s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.315s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.982s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1968463393',display_name='tempest-VolumesGetTest-Volume-1186418908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86993b93-dcee-4206-b24f-7f6ef90e3884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dac994e6e9437ca042331363c1209d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:13Z,use_quota=True,user_id='87d62c69bc924aa5800a18317928fba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Creating volume 86993b93-dcee-4206-b24f-7f6ef90e3884 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:18 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:18 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884 1073741824 Apr 24 19:23:18 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d27d85-223e-4afe-adba-e37c87ac076d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb65160-3858-4436-8dcc-5563e946739e', 'volume_size': 2, 'snapshot_id': '82f3770b-787b-472c-b8dd-437b83373c95'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfe760b-c39a-42e1-89dc-cdefc8be0c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:18 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume volume-bcb65160-3858-4436-8dcc-5563e946739e (bcb65160-3858-4436-8dcc-5563e946739e): created successfully Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfe760b-c39a-42e1-89dc-cdefc8be0c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Flow 'volume_create_manager' (11bfdcfe-02a7-4c81-a210-3e00dc21a2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:18 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e94dfd9a-c416-4f12-9efe-f77f184df9c8 tempest-VolumesSnapshotTestJSON-2048280815 None] Created volume successfully. Apr 24 19:23:18 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884 1073741824" returned: 0 in 0.662s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:18 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884 Apr 24 19:23:18 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:19 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884" returned: 0 in 0.434s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9a5e02-9d42-445b-bef7-45ea2dc9a765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86993b93-dcee-4206-b24f-7f6ef90e3884', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124583db-193c-4a07-b105-8faebd860f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:19 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Volume volume-86993b93-dcee-4206-b24f-7f6ef90e3884 (86993b93-dcee-4206-b24f-7f6ef90e3884): created successfully Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124583db-193c-4a07-b105-8faebd860f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Flow 'volume_create_manager' (64f77a60-bfc3-41bc-9971-228bb872bb62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:19 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-685ba113-c27f-4232-84b0-4f9ce549f544 tempest-VolumesGetTest-2015269625 None] Created volume successfully. Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-bcb65160-3858-4436-8dcc-5563e946739e-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-bcb65160-3858-4436-8dcc-5563e946739e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-bcb65160-3858-4436-8dcc-5563e946739e" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-bcb65160-3858-4436-8dcc-5563e946739e" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd9141f-e678-49ea-b251-b1ceafc98933]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:19 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e Apr 24 19:23:19 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-86993b93-dcee-4206-b24f-7f6ef90e3884-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Lock "cinder-86993b93-dcee-4206-b24f-7f6ef90e3884-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-quobyte-86993b93-dcee-4206-b24f-7f6ef90e3884" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-86993b93-dcee-4206-b24f-7f6ef90e3884" acquired by "delete_volume" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6236d3-37df-43e0-b69d-39e35b561e21]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:19 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884 Apr 24 19:23:19 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:20 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e" returned: 0 in 0.554s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:20 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e Apr 24 19:23:20 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:20 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884" returned: 0 in 0.511s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:20 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884 Apr 24 19:23:20 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:20 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-bcb65160-3858-4436-8dcc-5563e946739e" returned: 0 in 0.466s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-bcb65160-3858-4436-8dcc-5563e946739e" released by "delete_volume" :: held 1.068s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Created reservations ['34f8f14d-9616-4cd7-b9f2-a4867c35dc40', '5a809a3c-e014-4d17-98f9-2e9053b9729c', '3b2e0f04-2b2c-4cef-8842-29d248f00f96', '6da6d32f-e2f6-4b0e-9684-29ae41b4885d'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:20 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86993b93-dcee-4206-b24f-7f6ef90e3884" returned: 0 in 0.463s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:20 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:23:20 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-86993b93-dcee-4206-b24f-7f6ef90e3884" released by "delete_volume" :: held 1.013s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Created reservations ['abef3748-a534-4fd4-9e2c-ffb8d8840ca5', '848b96ff-38e1-406c-ab0e-88d1f728b402', '26fa8e3b-6463-448c-b319-5d74d739b82e', 'd5405665-ca09-4e4c-8322-5cf29330ecc1'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:21 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:23:21 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:21 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.497s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:21 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Deleted volume successfully. Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-84dc0249-5773-48a2-bef0-2a1576fcc951 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-bcb65160-3858-4436-8dcc-5563e946739e-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:21 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.475s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:21 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Deleted volume successfully. Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-f2666ec5-eb81-412c-a97b-ed7005a1e4ea tempest-VolumesGetTest-2015269625 None] Lock "cinder-86993b93-dcee-4206-b24f-7f6ef90e3884-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-82f3770b-787b-472c-b8dd-437b83373c95-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-82f3770b-787b-472c-b8dd-437b83373c95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-82f3770b-787b-472c-b8dd-437b83373c95" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-82f3770b-787b-472c-b8dd-437b83373c95" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Deleting offline snapshot 82f3770b-787b-472c-b8dd-437b83373c95 of volume 4e9555bc-b243-4bf3-b674-2bcb73f80e6b {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] snapshot_file for this snap is: volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a12bcf-4c15-4acc-8258-9737af89308a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:21 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 Apr 24 19:23:21 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-e4c739b1-cea3-41f3-b12c-67be3f810f45-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Lock "cinder-e4c739b1-cea3-41f3-b12c-67be3f810f45-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Acquiring lock "cinder-quobyte-e4c739b1-cea3-41f3-b12c-67be3f810f45" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-e4c739b1-cea3-41f3-b12c-67be3f810f45" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce670ef-e571-4b92-be2c-637f75fa219a]: (4, 'raw') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:22 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 Apr 24 19:23:22 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:22 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95" returned: 0 in 0.636s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fbe979-4387-4b3c-900e-21f0c7fbc537]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:22 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b Apr 24 19:23:22 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:22 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45" returned: 0 in 0.621s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:22 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 Apr 24 19:23:22 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:23 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" returned: 0 in 0.702s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:23 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 Apr 24 19:23:23 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:23 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45" returned: 1 in 0.646s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45' failed. Not Retrying. {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 19:23:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:23 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45 Apr 24 19:23:23 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:23 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95" returned: 0 in 0.630s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:23 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95 Apr 24 19:23:23 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:24 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-e4c739b1-cea3-41f3-b12c-67be3f810f45" returned: 0 in 0.544s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Lock "cinder-quobyte-e4c739b1-cea3-41f3-b12c-67be3f810f45" released by "delete_volume" :: held 1.899s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Created reservations ['8410bb5d-aa45-4e0a-ac5e-42c0cd34aea8', 'a1132568-3110-401b-bdbe-21dde79f0532', '0428dd3d-7676-408b-a6bb-80b45e32234f', 'e14e6080-fe04-4bda-b51e-bba52955334c'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:24 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:23:24 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:24 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b.82f3770b-787b-472c-b8dd-437b83373c95" returned: 0 in 0.520s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-82f3770b-787b-472c-b8dd-437b83373c95" released by "_delete_snapshot" :: held 2.613s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" released by "delete_snapshot" :: held 2.640s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Created reservations ['694c39ea-0a28-430e-b7e4-ff2a29723928', '714588e8-a69a-4bc1-b11d-1293329a4871', '9f860f93-143f-4ac3-9bd0-b95e6f541e7f', '67a67462-6b0e-4192-b84f-7af042adfbb2'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:24 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Delete snapshot completed successfully. Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-1be4e7bc-dbbe-4f0e-a659-75d670f22ff1 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-82f3770b-787b-472c-b8dd-437b83373c95-delete_snapshot" released by "delete_snapshot" :: held 2.811s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:24 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.610s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:24 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Deleted volume successfully. Apr 24 19:23:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a84a3901-8ea0-4040-95b1-a17a99714630 tempest-VolumesGetTest-2015269625 None] Lock "cinder-e4c739b1-cea3-41f3-b12c-67be3f810f45-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-4e9555bc-b243-4bf3-b674-2bcb73f80e6b-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-4e9555bc-b243-4bf3-b674-2bcb73f80e6b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" acquired by "delete_volume" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:25 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[734eb623-b711-4428-a0c1-33855f2e15b0]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:25 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b Apr 24 19:23:25 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:25 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" returned: 0 in 0.645s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:25 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b Apr 24 19:23:25 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:26 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" returned: 0 in 0.554s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-4e9555bc-b243-4bf3-b674-2bcb73f80e6b" released by "delete_volume" :: held 1.280s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:26 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Created reservations ['2ecb18a8-0f99-47af-a85f-f6f93078adac', 'deeb3c05-6465-40e1-85e5-3f3ec99d12ab', '3582d903-d0e6-4f2d-b7c7-b2785b0f0700', '18fb9bec-9141-47f0-a473-de71eb17a79a'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:26 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:23:26 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:27 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.573s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Flow 'volume_create_manager' (4b4a4317-8384-426e-9b29-9061e62fabfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215c28a5-435a-41f3-8a84-96d104f649a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Deleted volume successfully. Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215c28a5-435a-41f3-8a84-96d104f649a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-158560917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2e46d4-d124-4b66-b9b8-433d60a226d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303a53ca5cfc4cd4a7010c086786a87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:27Z,use_quota=True,user_id='6b47e7bf25954af9b02b00356af41bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875f705e-6933-4afa-bf64-dd86b41ce9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875f705e-6933-4afa-bf64-dd86b41ce9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c51861-e9f9-4a1d-b5b7-b8e9a57391f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c51861-e9f9-4a1d-b5b7-b8e9a57391f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce2e46d4-d124-4b66-b9b8-433d60a226d4', 'volume_name': 'volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99135fd-37eb-411b-b6c4-1455b84b8872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99135fd-37eb-411b-b6c4-1455b84b8872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c442b0-5dae-48a6-9fd9-cca048c8b869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Volume ce2e46d4-d124-4b66-b9b8-433d60a226d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4', 'volume_size': 1} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-158560917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2e46d4-d124-4b66-b9b8-433d60a226d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='303a53ca5cfc4cd4a7010c086786a87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:27Z,use_quota=True,user_id='6b47e7bf25954af9b02b00356af41bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Creating volume ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:27 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:27 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 1073741824 Apr 24 19:23:27 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-7e324202-237f-4e7a-b2ee-c3a114612916 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-4e9555bc-b243-4bf3-b674-2bcb73f80e6b-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Flow 'volume_create_manager' (9ae22aab-7aef-424d-a09b-32f806ad7eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed58149-9bfd-41c1-a736-021911f62be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed58149-9bfd-41c1-a736-021911f62be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-824190224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d1891c-d268-469d-a7b4-146f4c62fb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea3fd5fbe6e409baf9a7308d1976867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:28Z,use_quota=True,user_id='1a15a29619964ec4a05890625adce32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd8c0bf-fa53-4b23-8c0b-17d1c347649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd8c0bf-fa53-4b23-8c0b-17d1c347649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6feb47-be47-4e65-b124-fc71acea4cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6feb47-be47-4e65-b124-fc71acea4cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d1891c-d268-469d-a7b4-146f4c62fb85', 'volume_name': 'volume-f4d1891c-d268-469d-a7b4-146f4c62fb85', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321972bf-0573-4959-b17b-0903ee8c6f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321972bf-0573-4959-b17b-0903ee8c6f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4741cf3c-a345-4926-b90e-13a23a20033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:27 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume f4d1891c-d268-469d-a7b4-146f4c62fb85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d1891c-d268-469d-a7b4-146f4c62fb85', 'volume_size': 1} Apr 24 19:23:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:28 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 1073741824" returned: 0 in 0.830s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:28 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 Apr 24 19:23:28 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:28 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4" returned: 0 in 0.449s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.640s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-824190224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d1891c-d268-469d-a7b4-146f4c62fb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea3fd5fbe6e409baf9a7308d1976867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:28Z,use_quota=True,user_id='1a15a29619964ec4a05890625adce32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Creating volume f4d1891c-d268-469d-a7b4-146f4c62fb85 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:28 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c442b0-5dae-48a6-9fd9-cca048c8b869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d4d8e4-8d98-4d5c-b71a-41208bf9b0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:28 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 1073741824 Apr 24 19:23:28 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:28 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Volume volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 (ce2e46d4-d124-4b66-b9b8-433d60a226d4): created successfully Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d4d8e4-8d98-4d5c-b71a-41208bf9b0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:28 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Flow 'volume_create_manager' (4b4a4317-8384-426e-9b29-9061e62fabfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-75ba33d5-49a5-45ab-a8bc-94097deac468 tempest-VolumesSnapshotListTestJSON-1988002975 None] Created volume successfully. Apr 24 19:23:29 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 1073741824" returned: 0 in 0.699s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:29 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 Apr 24 19:23:29 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:29 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85" returned: 0 in 0.503s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.302s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4741cf3c-a345-4926-b90e-13a23a20033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d1891c-d268-469d-a7b4-146f4c62fb85', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99dfc3b3-44dd-42ac-a0eb-3bf40938315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] Creating offline snapshot 1c75fd83-4331-4b29-bc5f-194d722c03e0 of volume ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:23:29 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 (f4d1891c-d268-469d-a7b4-146f4c62fb85): created successfully Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99dfc3b3-44dd-42ac-a0eb-3bf40938315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Flow 'volume_create_manager' (9ae22aab-7aef-424d-a09b-32f806ad7eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daf1d73-c94c-48f9-a013-0e3460c382d5]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:29 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6249346c-5719-4fa9-af8c-e05924b63545 tempest-VolumesSnapshotTestJSON-2048280815 None] Created volume successfully. Apr 24 19:23:30 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 Apr 24 19:23:30 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:30 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4" returned: 0 in 0.576s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:30 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 1G Apr 24 19:23:30 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:31 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 1G" returned: 0 in 0.662s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:31 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 Apr 24 19:23:31 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:31 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0" returned: 0 in 0.583s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:31 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 is being set with open permissions: ugo+rw Apr 24 19:23:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:31 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 Apr 24 19:23:31 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:32 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0" returned: 0 in 0.509s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:32 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.info Apr 24 19:23:32 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:32 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.info" returned: 0 in 0.511s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:32 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.info is being set with open permissions: ugo+rw Apr 24 19:23:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:32 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.info Apr 24 19:23:32 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:33 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.info" returned: 0 in 0.489s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.460s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.042s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] Creating offline snapshot 5c2ef18a-0580-41ff-a1eb-2b40fc43b41a of volume f4d1891c-d268-469d-a7b4-146f4c62fb85 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:23:33 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-44ab1172-5b97-427c-99e3-4fd11b78937d tempest-VolumesSnapshotListTestJSON-1988002975 None] Create snapshot completed successfully Apr 24 19:23:33 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb9717e-38e1-4acd-902f-48b496874c4b]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:33 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 Apr 24 19:23:33 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:34 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85" returned: 0 in 0.644s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:34 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a 1G Apr 24 19:23:34 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:34 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a 1G" returned: 0 in 0.620s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:34 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a Apr 24 19:23:34 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:35 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a" returned: 0 in 0.546s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:35 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a is being set with open permissions: ugo+rw Apr 24 19:23:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:35 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a Apr 24 19:23:35 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:35 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a" returned: 0 in 0.448s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:35 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.info Apr 24 19:23:35 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:36 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.info" returned: 0 in 0.452s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:36 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.info is being set with open permissions: ugo+rw Apr 24 19:23:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:36 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.info Apr 24 19:23:36 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:36 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.info" returned: 0 in 0.515s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.328s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.749s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:36 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] Creating offline snapshot 49c1951d-8c01-4568-a7b6-fde5b659d2f1 of volume ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:23:36 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-ca49096b-df55-49ee-9a18-7e943ddcfff8 tempest-VolumesSnapshotTestJSON-2048280815 None] Create snapshot completed successfully Apr 24 19:23:36 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b13e59-48be-4ba4-88b7-5dc4918ecd70]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:36 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 Apr 24 19:23:36 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:37 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0" returned: 0 in 0.563s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:37 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:37 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 1G Apr 24 19:23:37 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Flow 'volume_create_manager' (c1ae3bf5-70a7-424e-ba38-34e5224d0a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e744929d-218e-40a1-a02d-f3b2786f4c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e744929d-218e-40a1-a02d-f3b2786f4c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-335860034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c23fe5a9-6bae-45ee-840c-b0d5390b53a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea3fd5fbe6e409baf9a7308d1976867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c2ef18a-0580-41ff-a1eb-2b40fc43b41a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:23:38Z,use_quota=True,user_id='1a15a29619964ec4a05890625adce32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7c93da-5700-4396-b3c4-f22a7c3fe502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7c93da-5700-4396-b3c4-f22a7c3fe502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235d875f-5095-45f4-a6e1-4429844d299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:38 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235d875f-5095-45f4-a6e1-4429844d299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c23fe5a9-6bae-45ee-840c-b0d5390b53a0', 'volume_name': 'volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0', 'volume_size': 1, 'snapshot_id': '5c2ef18a-0580-41ff-a1eb-2b40fc43b41a'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd88b7e-ed64-46a5-89cf-d5d027dc1d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd88b7e-ed64-46a5-89cf-d5d027dc1d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f6ef6c-3266-447b-9070-061f56fee576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:38 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume c23fe5a9-6bae-45ee-840c-b0d5390b53a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0', 'volume_size': 1, 'snapshot_id': '5c2ef18a-0580-41ff-a1eb-2b40fc43b41a'} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 1G" returned: 0 in 0.783s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:38 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 Apr 24 19:23:38 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:38 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1" returned: 0 in 0.455s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:38 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 is being set with open permissions: ugo+rw Apr 24 19:23:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:38 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 Apr 24 19:23:38 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:39 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1" returned: 0 in 0.424s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.901s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-5c2ef18a-0580-41ff-a1eb-2b40fc43b41a-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" by "_create_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-5c2ef18a-0580-41ff-a1eb-2b40fc43b41a-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Creating volume c23fe5a9-6bae-45ee-840c-b0d5390b53a0 from snapshot 5c2ef18a-0580-41ff-a1eb-2b40fc43b41a {{(pid=82057) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:39 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-661ea4c6-85ee-4c25-8962-310897159a85 tempest-VolumesSnapshotListTestJSON-1988002975 None] Create snapshot completed successfully Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] snapshot: 5c2ef18a-0580-41ff-a1eb-2b40fc43b41a, volume: c23fe5a9-6bae-45ee-840c-b0d5390b53a0, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[53922253-c31f-4b9a-959f-8b339bb1f2c4]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:39 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a Apr 24 19:23:39 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:39 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a" returned: 0 in 0.556s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d1891c-d268-469d-a7b4-146f4c62fb85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed9d257-589d-48c7-a10d-2d5267a10c26]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:39 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 Apr 24 19:23:39 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:40 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85" returned: 0 in 0.502s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:40 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:23:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:40 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 Apr 24 19:23:40 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:44 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" returned: 0 in 4.397s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:44 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[90548181-4b12-4018-a750-00701e157f4f]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:44 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 Apr 24 19:23:44 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:45 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85" returned: 0 in 0.654s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:23:45 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Converted 1024.00 MB image at 232.76 MB/s Apr 24 19:23:45 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 is being set with open permissions: ugo+rw Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:45 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 Apr 24 19:23:45 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:45 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" returned: 0 in 0.464s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" released by "_copy_volume_from_snapshot" :: held 6.689s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-5c2ef18a-0580-41ff-a1eb-2b40fc43b41a-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" released by "_create_volume_from_snapshot" :: held 6.740s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.775s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.434s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] Creating offline snapshot 7923fea4-86a8-4482-b108-04f5250228fb of volume ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f6ef6c-3266-447b-9070-061f56fee576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0', 'volume_size': 1, 'snapshot_id': '5c2ef18a-0580-41ff-a1eb-2b40fc43b41a'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795b20a2-5621-4989-be1c-e9bdec4b5dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82b23b7-47ba-4670-96f5-d471f30241ed]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=103,cinder:UPDATE=100,cinder:INSERT=31,cinder:DELETE=8 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:23:45 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Volume volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 (c23fe5a9-6bae-45ee-840c-b0d5390b53a0): created successfully Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795b20a2-5621-4989-be1c-e9bdec4b5dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:23:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Flow 'volume_create_manager' (c1ae3bf5-70a7-424e-ba38-34e5224d0a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:23:46 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-5f327413-e2be-4a03-b960-0e12ea847360 tempest-VolumesSnapshotTestJSON-2048280815 None] Created volume successfully. Apr 24 19:23:46 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 Apr 24 19:23:46 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:46 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1" returned: 0 in 0.608s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:46 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:46 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb 1G Apr 24 19:23:46 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:46 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-c23fe5a9-6bae-45ee-840c-b0d5390b53a0-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:46 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-c23fe5a9-6bae-45ee-840c-b0d5390b53a0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:46 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:46 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" acquired by "delete_volume" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:46 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8d06f8-4916-4a8e-85b4-efcaf90470d2]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:46 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 Apr 24 19:23:46 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:47 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb 1G" returned: 0 in 0.824s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:47 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb Apr 24 19:23:47 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:47 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" returned: 0 in 0.631s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:47 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0 Apr 24 19:23:47 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:47 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb" returned: 0 in 0.564s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:47 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb is being set with open permissions: ugo+rw Apr 24 19:23:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:47 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb Apr 24 19:23:47 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:48 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" returned: 0 in 0.548s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-c23fe5a9-6bae-45ee-840c-b0d5390b53a0" released by "delete_volume" :: held 1.226s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Created reservations ['013b4d12-602e-4a2c-a724-0417a2e31a6f', '0913894d-3022-43f2-bd17-5dcd1d1b14b1', '48433362-e359-4872-a40d-57fb2a5fb40a', 'b1c1402b-9d2b-4a81-a072-4d00cecdfe0f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:48 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:23:48 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:48 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb" returned: 0 in 0.508s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.663s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:48 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c6df45c0-73a0-41e6-b795-d777842ca2b8 tempest-VolumesSnapshotListTestJSON-1988002975 None] Create snapshot completed successfully Apr 24 19:23:48 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.486s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:48 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Deleted volume successfully. Apr 24 19:23:48 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9fc7328c-442d-424c-ba05-ea5d5b6d14a3 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-c23fe5a9-6bae-45ee-840c-b0d5390b53a0-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-5c2ef18a-0580-41ff-a1eb-2b40fc43b41a-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-5c2ef18a-0580-41ff-a1eb-2b40fc43b41a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-f4d1891c-d268-469d-a7b4-146f4c62fb85" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-f4d1891c-d268-469d-a7b4-146f4c62fb85" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-5c2ef18a-0580-41ff-a1eb-2b40fc43b41a" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-5c2ef18a-0580-41ff-a1eb-2b40fc43b41a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Deleting offline snapshot 5c2ef18a-0580-41ff-a1eb-2b40fc43b41a of volume f4d1891c-d268-469d-a7b4-146f4c62fb85 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] snapshot_file for this snap is: volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f122590-08a0-486d-969e-5de04e403963]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:49 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a Apr 24 19:23:49 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "cinder-7923fea4-86a8-4482-b108-04f5250228fb-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-7923fea4-86a8-4482-b108-04f5250228fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "cinder-quobyte-7923fea4-86a8-4482-b108-04f5250228fb" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-7923fea4-86a8-4482-b108-04f5250228fb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Deleting offline snapshot 7923fea4-86a8-4482-b108-04f5250228fb of volume ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] snapshot_file for this snap is: volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cdc9eb-8857-47d9-8e99-7492f84ac4a5]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:49 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a" returned: 0 in 0.626s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d1891c-d268-469d-a7b4-146f4c62fb85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:49 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb Apr 24 19:23:49 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[466f768a-8d79-44ab-8dec-57fe11f3e801]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:49 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 Apr 24 19:23:49 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:50 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb" returned: 0 in 0.603s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:50 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bcb56e-9fa1-4896-9df7-ccc333b3648e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:50 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85" returned: 0 in 0.572s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:50 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 Apr 24 19:23:50 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:50 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a Apr 24 19:23:50 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:50 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1" returned: 0 in 0.564s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:50 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb Apr 24 19:23:50 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:51 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a" returned: 0 in 0.591s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:51 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a Apr 24 19:23:51 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:51 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85.5c2ef18a-0580-41ff-a1eb-2b40fc43b41a" returned: 0 in 0.503s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-5c2ef18a-0580-41ff-a1eb-2b40fc43b41a" released by "_delete_snapshot" :: held 2.400s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-f4d1891c-d268-469d-a7b4-146f4c62fb85" released by "delete_snapshot" :: held 2.427s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:51 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb" returned: 0 in 0.685s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:51 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Created reservations ['305600dc-af8e-40bf-872a-6020b3785750', '8d53ab0e-3592-4dbb-9917-d6ed1ce8dcf7', '14195e0d-b32a-43bf-81bc-221052c008e0', '9c65def3-50df-4e14-9151-3849e58182db'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:51 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb Apr 24 19:23:51 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:51 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Delete snapshot completed successfully. Apr 24 19:23:51 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4ca5c7f0-c69e-4789-9794-87f1159b201d tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-5c2ef18a-0580-41ff-a1eb-2b40fc43b41a-delete_snapshot" released by "delete_snapshot" :: held 2.593s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:52 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.7923fea4-86a8-4482-b108-04f5250228fb" returned: 0 in 0.497s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-7923fea4-86a8-4482-b108-04f5250228fb" released by "_delete_snapshot" :: held 2.461s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" released by "delete_snapshot" :: held 2.487s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Created reservations ['d23a8272-d68c-47a4-9b75-5c6d80031a39', 'c92ccdd6-358b-47d0-ac56-1f8bddb12de2', 'fb844f37-2d98-4159-b6e7-7a7c61c16f4f', '695a27cb-fdf9-4694-bdc2-4e7365f37e41'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:52 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Delete snapshot completed successfully. Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c7cc1440-1c1c-4923-a703-93fd870eeacc tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-7923fea4-86a8-4482-b108-04f5250228fb-delete_snapshot" released by "delete_snapshot" :: held 2.648s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-f4d1891c-d268-469d-a7b4-146f4c62fb85-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-f4d1891c-d268-469d-a7b4-146f4c62fb85-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-f4d1891c-d268-469d-a7b4-146f4c62fb85" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-f4d1891c-d268-469d-a7b4-146f4c62fb85" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a9dfe2-20a7-4191-8d10-41ade0e455e2]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:52 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 Apr 24 19:23:52 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "cinder-49c1951d-8c01-4568-a7b6-fde5b659d2f1-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-49c1951d-8c01-4568-a7b6-fde5b659d2f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "cinder-quobyte-49c1951d-8c01-4568-a7b6-fde5b659d2f1" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-49c1951d-8c01-4568-a7b6-fde5b659d2f1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Deleting offline snapshot 49c1951d-8c01-4568-a7b6-fde5b659d2f1 of volume ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] snapshot_file for this snap is: volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd71961-129a-47b6-a3be-58e55061c07b]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:53 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 Apr 24 19:23:53 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:53 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85" returned: 0 in 0.616s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:53 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85 Apr 24 19:23:53 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:53 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1" returned: 0 in 0.657s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[493df5d1-cc77-41ed-b091-10346fba53db]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:53 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-f4d1891c-d268-469d-a7b4-146f4c62fb85" returned: 0 in 0.541s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-f4d1891c-d268-469d-a7b4-146f4c62fb85" released by "delete_volume" :: held 1.240s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Created reservations ['3c65dca9-a3c9-40ff-8206-02ec08b533f3', 'f3c211db-9235-4d77-b658-56b48020a8f3', '969aef67-6289-4205-810b-41b647af70b1', '815e36df-4016-4f43-a900-9ebad58b5a7f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:53 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 Apr 24 19:23:53 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:53 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:23:53 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:54 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0" returned: 0 in 0.617s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:54 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 Apr 24 19:23:54 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:54 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.516s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:54 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Deleted volume successfully. Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-af62e4fc-b3f6-4172-b2f9-afc2515118b4 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-f4d1891c-d268-469d-a7b4-146f4c62fb85-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-58ce9449-9e92-4f1f-95fe-21c801ec0ffa-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-58ce9449-9e92-4f1f-95fe-21c801ec0ffa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "cinder-quobyte-58ce9449-9e92-4f1f-95fe-21c801ec0ffa" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-58ce9449-9e92-4f1f-95fe-21c801ec0ffa" acquired by "delete_volume" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd4364c-1a19-46db-a6a9-39f537f73f85]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:54 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa Apr 24 19:23:54 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:55 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1" returned: 0 in 0.729s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:55 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1 Apr 24 19:23:55 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:55 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa" returned: 0 in 0.623s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:55 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.49c1951d-8c01-4568-a7b6-fde5b659d2f1" returned: 0 in 0.506s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:55 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa Apr 24 19:23:55 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-49c1951d-8c01-4568-a7b6-fde5b659d2f1" released by "_delete_snapshot" :: held 2.625s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" released by "delete_snapshot" :: held 2.651s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:55 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Created reservations ['1cc83b79-81e5-4920-aec1-c7e49218060e', '48e08ceb-7197-4d83-aa2a-3ffec85473ee', '257a1112-1250-49cb-8d6f-4eeafd1d0f43', '24b19a58-38e4-4fbf-acbf-a05bf7e5252d'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:55 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Delete snapshot completed successfully. Apr 24 19:23:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-788e3ec4-8f32-44f4-a447-bab87a41421f tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-49c1951d-8c01-4568-a7b6-fde5b659d2f1-delete_snapshot" released by "delete_snapshot" :: held 2.802s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:56 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-58ce9449-9e92-4f1f-95fe-21c801ec0ffa" returned: 0 in 0.536s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "cinder-1c75fd83-4331-4b29-bc5f-194d722c03e0-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-quobyte-58ce9449-9e92-4f1f-95fe-21c801ec0ffa" released by "delete_volume" :: held 1.231s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-1c75fd83-4331-4b29-bc5f-194d722c03e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "cinder-quobyte-1c75fd83-4331-4b29-bc5f-194d722c03e0" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-1c75fd83-4331-4b29-bc5f-194d722c03e0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Deleting offline snapshot 1c75fd83-4331-4b29-bc5f-194d722c03e0 of volume ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] snapshot_file for this snap is: volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Created reservations ['436cdf35-836c-4ed0-85d7-718a1a458b80', '5ea2dc5a-2ba7-4cdd-992e-f8aa37dfc2e6', 'c3a946b9-3fec-417a-b5ea-1111d7f9a8a1', '44e80595-a336-4304-8730-f6d1ffbc665f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e168e677-96dc-45ab-9af8-8cec9fdfd7b3]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:56 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 Apr 24 19:23:56 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:56 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:23:56 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:56 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.466s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:56 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Deleted volume successfully. Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5d5fd5e3-3d6c-4878-b1af-c68e1d780752 tempest-VolumesSnapshotTestJSON-2048280815 None] Lock "cinder-58ce9449-9e92-4f1f-95fe-21c801ec0ffa-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:56 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0" returned: 0 in 0.618s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99b80e5-79ed-4d9e-8003-7734c3e266fb]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:56 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 Apr 24 19:23:56 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:57 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4" returned: 0 in 0.605s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:57 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 Apr 24 19:23:57 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:58 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0" returned: 0 in 0.658s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:58 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0 Apr 24 19:23:58 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:58 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:23:58 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:23:58 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4.1c75fd83-4331-4b29-bc5f-194d722c03e0" returned: 0 in 0.498s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-1c75fd83-4331-4b29-bc5f-194d722c03e0" released by "_delete_snapshot" :: held 2.507s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" released by "delete_snapshot" :: held 2.542s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Created reservations ['c3ac8dc8-0f40-49de-aaad-b80f0de53aa1', '09dbd5e6-80cc-483c-87a4-a47ff6d02e20', '4ecffccf-d718-45de-b2e9-7856dca6424f', '8866d5bd-c3cd-402b-99e9-59b69bc76538'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:23:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Delete snapshot completed successfully. Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-91281570-593f-44bd-b9a2-e0dd8ef44291 tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-1c75fd83-4331-4b29-bc5f-194d722c03e0-delete_snapshot" released by "delete_snapshot" :: held 2.696s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:23:58 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.583s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:23:58 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:23:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "cinder-ce2e46d4-d124-4b66-b9b8-433d60a226d4-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-ce2e46d4-d124-4b66-b9b8-433d60a226d4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:23:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:23:59 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8923e48-ac02-40f5-a35c-874befed0b7e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:23:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:23:59 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 Apr 24 19:23:59 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:00 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4" returned: 0 in 0.668s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:00 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4 Apr 24 19:24:00 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:00 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ce2e46d4-d124-4b66-b9b8-433d60a226d4" returned: 0 in 0.505s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:00 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-quobyte-ce2e46d4-d124-4b66-b9b8-433d60a226d4" released by "delete_volume" :: held 1.240s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:00 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Created reservations ['e517eed3-152b-47b6-b527-deb5185d7241', '2631278d-eced-45ee-b525-40ae0d1e538d', 'ee318b79-07c7-4552-abd9-ec149b99d8b9', '91d79b88-201e-4b3b-93bd-b620e9daae41'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:00 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:24:00 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:01 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.522s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:01 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Deleted volume successfully. Apr 24 19:24:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-82f7cfe6-2ebd-4efd-a5d4-97d9afcb2abf tempest-VolumesSnapshotListTestJSON-1988002975 None] Lock "cinder-ce2e46d4-d124-4b66-b9b8-433d60a226d4-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (8d90cdac-ce8e-48dd-b5d6-4dc50d771f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d0fcd-2932-43a2-ac48-71cf252a98de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d0fcd-2932-43a2-ac48-71cf252a98de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699963805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ea1c5c-6e30-4258-88ee-057f7ca562ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:04Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc550ffe-dcaa-4751-ad9c-304a27157d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc550ffe-dcaa-4751-ad9c-304a27157d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d156f239-0bf8-47c8-bdcc-173095827c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d156f239-0bf8-47c8-bdcc-173095827c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ea1c5c-6e30-4258-88ee-057f7ca562ff', 'volume_name': 'volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45974a6e-f153-4a37-b9de-d7e659ae8696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45974a6e-f153-4a37-b9de-d7e659ae8696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee338a40-6d46-4072-8284-bd862bfa14c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:04 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume 62ea1c5c-6e30-4258-88ee-057f7ca562ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff', 'volume_size': 1} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699963805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ea1c5c-6e30-4258-88ee-057f7ca562ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:04Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Creating volume 62ea1c5c-6e30-4258-88ee-057f7ca562ff {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:04 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:04 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff 1073741824 Apr 24 19:24:04 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:04 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff 1073741824" returned: 0 in 0.614s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:05 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff Apr 24 19:24:05 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:05 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff" returned: 0 in 0.548s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:05 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee338a40-6d46-4072-8284-bd862bfa14c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3790b690-76a0-4232-9eae-c1545e151a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:05 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff (62ea1c5c-6e30-4258-88ee-057f7ca562ff): created successfully Apr 24 19:24:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3790b690-76a0-4232-9eae-c1545e151a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (8d90cdac-ce8e-48dd-b5d6-4dc50d771f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:05 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-bee91cb7-4664-43e8-88a1-3e8fe749b4cf tempest-CreateVolumesFromSnapshotTest-348720364 None] Created volume successfully. Apr 24 19:24:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] Creating offline snapshot 40df6d5a-9dc7-48c4-967e-89585a3086a7 of volume 62ea1c5c-6e30-4258-88ee-057f7ca562ff {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:24:06 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea2e214-126b-41dc-9ff5-5421fec6485a]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:06 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff Apr 24 19:24:06 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:07 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff" returned: 0 in 0.552s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:07 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 1G Apr 24 19:24:07 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:07 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 1G" returned: 0 in 0.652s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:07 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 Apr 24 19:24:07 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:08 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7" returned: 0 in 0.473s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:08 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 is being set with open permissions: ugo+rw Apr 24 19:24:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:08 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 Apr 24 19:24:08 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:08 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7" returned: 0 in 0.475s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:08 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.info Apr 24 19:24:08 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:09 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.info" returned: 0 in 0.452s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:09 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.info is being set with open permissions: ugo+rw Apr 24 19:24:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:09 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.info Apr 24 19:24:09 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:09 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.info" returned: 0 in 0.470s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.172s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:09 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:UPDATE=116,cinder:DELETE=12,cinder:SELECT=88,cinder:INSERT=29 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:24:09 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-ec23e324-b0fe-458c-8b61-95e779829203 tempest-CreateVolumesFromSnapshotTest-348720364 None] Create snapshot completed successfully Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (f1597783-9a4a-4cee-9779-1a336c86b17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b4c3f1-505e-4f04-affc-2613e98dfee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b4c3f1-505e-4f04-affc-2613e98dfee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1569071202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:11Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0efba3-a0e4-458b-897d-33b81223eb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0efba3-a0e4-458b-897d-33b81223eb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea8bc86-08f3-44fa-897a-34d8e44c87cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea8bc86-08f3-44fa-897a-34d8e44c87cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a', 'volume_name': 'volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b021784-7e10-4063-bd9c-93d2c8a7cb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b021784-7e10-4063-bd9c-93d2c8a7cb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f32140d-7375-4914-a5d9-7bc4889f3001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume 60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a', 'volume_size': 1} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1569071202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:11Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Creating volume 60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:11 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:11 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a 1073741824 Apr 24 19:24:11 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (40dafef9-66a5-47be-8a68-f3460ae1ad2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e4fe44-f057-454b-849d-0604bd99356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e4fe44-f057-454b-849d-0604bd99356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14497345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a05b13-5ecc-4ec4-9325-25462cfaa2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:11Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11514975-5317-4f7e-b8a9-b79bf24374fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11514975-5317-4f7e-b8a9-b79bf24374fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d453e844-ac02-4bf9-a194-5d72b7428a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d453e844-ac02-4bf9-a194-5d72b7428a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a05b13-5ecc-4ec4-9325-25462cfaa2af', 'volume_name': 'volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6367261-2bc0-4a00-a238-fdff0e8a8454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6367261-2bc0-4a00-a238-fdff0e8a8454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e142d798-5123-4319-887c-4d15648d1d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume b6a05b13-5ecc-4ec4-9325-25462cfaa2af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af', 'volume_size': 1} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (fa758dfb-a5af-467c-a395-303177a81a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e21b847-b4cf-44e5-ac3c-0bc47d35f80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e21b847-b4cf-44e5-ac3c-0bc47d35f80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1301343943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7404b3fe-263e-46e9-8d9d-0c44c2eab48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:12Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce98d78-13ea-4f46-8fbd-b7d840220ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ce98d78-13ea-4f46-8fbd-b7d840220ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3389592b-6437-47f3-aab6-2f22934bab6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3389592b-6437-47f3-aab6-2f22934bab6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7404b3fe-263e-46e9-8d9d-0c44c2eab48f', 'volume_name': 'volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f58e083-85f5-4372-8c2b-e54617233644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f58e083-85f5-4372-8c2b-e54617233644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a91f577-2199-4fdb-9457-4cf5b5344eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:11 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume 7404b3fe-263e-46e9-8d9d-0c44c2eab48f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f', 'volume_size': 1} Apr 24 19:24:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:12 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a 1073741824" returned: 0 in 0.878s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:12 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a Apr 24 19:24:12 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (3b1036d4-73ff-4618-bf44-685e5c60d9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffed53d-a9ef-4232-bdca-28374c62396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffed53d-a9ef-4232-bdca-28374c62396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2105514731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76d47f5-75b1-4740-90de-934f140511a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:12Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3017d005-769a-4137-b60e-8a066b10c4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3017d005-769a-4137-b60e-8a066b10c4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249063a6-808e-47d8-b684-7d898134855b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249063a6-808e-47d8-b684-7d898134855b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76d47f5-75b1-4740-90de-934f140511a3', 'volume_name': 'volume-d76d47f5-75b1-4740-90de-934f140511a3', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b2ac85-f504-4e49-bbef-3cd4b9e573b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b2ac85-f504-4e49-bbef-3cd4b9e573b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917098cc-61ed-4efd-9fba-62ebe76e2e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:12 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume d76d47f5-75b1-4740-90de-934f140511a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76d47f5-75b1-4740-90de-934f140511a3', 'volume_size': 1} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (e3a755da-f653-497f-bdcf-895f7216bd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ba35f9-a432-45a0-b482-040acfef107f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ba35f9-a432-45a0-b482-040acfef107f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-763464326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c993de6-5481-40bd-ab44-5d8b2f305398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:12Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a84f489-d28b-491f-bd53-4665ee2bcbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a84f489-d28b-491f-bd53-4665ee2bcbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfcc121-34aa-4ee7-8ebc-edb27a95746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfcc121-34aa-4ee7-8ebc-edb27a95746b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c993de6-5481-40bd-ab44-5d8b2f305398', 'volume_name': 'volume-6c993de6-5481-40bd-ab44-5d8b2f305398', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac85e20-0357-4ba5-9ed7-d44085f0b330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac85e20-0357-4ba5-9ed7-d44085f0b330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33aa20f8-e6e2-4bdf-b193-aced3d9fccd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:12 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume 6c993de6-5481-40bd-ab44-5d8b2f305398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c993de6-5481-40bd-ab44-5d8b2f305398', 'volume_size': 1} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:12 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a" returned: 0 in 0.496s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14497345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a05b13-5ecc-4ec4-9325-25462cfaa2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:11Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Creating volume b6a05b13-5ecc-4ec4-9325-25462cfaa2af {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:12 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:12 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af 1073741824 Apr 24 19:24:12 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f32140d-7375-4914-a5d9-7bc4889f3001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae6b2c9-63f9-4ed3-9732-5b23fc136f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:12 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a (60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a): created successfully Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae6b2c9-63f9-4ed3-9732-5b23fc136f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (f1597783-9a4a-4cee-9779-1a336c86b17c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:12 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-2bee7564-49f7-43c3-a16a-31090029286f tempest-CreateVolumesFromSnapshotTest-348720364 None] Created volume successfully. Apr 24 19:24:13 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af 1073741824" returned: 0 in 0.692s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:13 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af Apr 24 19:24:13 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:13 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af" returned: 0 in 0.471s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.913s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1301343943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7404b3fe-263e-46e9-8d9d-0c44c2eab48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:12Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Creating volume 7404b3fe-263e-46e9-8d9d-0c44c2eab48f {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:13 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e142d798-5123-4319-887c-4d15648d1d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:13 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f 1073741824 Apr 24 19:24:13 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384f609b-e7ae-4268-bc4f-a811cf28bdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:13 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af (b6a05b13-5ecc-4ec4-9325-25462cfaa2af): created successfully Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384f609b-e7ae-4268-bc4f-a811cf28bdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (40dafef9-66a5-47be-8a68-f3460ae1ad2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:13 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-14a2ae5c-8bf2-4c3c-910f-a1d95c04b1a3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Created volume successfully. Apr 24 19:24:14 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f 1073741824" returned: 0 in 0.598s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:14 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f Apr 24 19:24:14 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:14 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f" returned: 0 in 0.443s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.571s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2105514731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76d47f5-75b1-4740-90de-934f140511a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:12Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Creating volume d76d47f5-75b1-4740-90de-934f140511a3 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:14 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:14 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3 1073741824 Apr 24 19:24:14 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a91f577-2199-4fdb-9457-4cf5b5344eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167e1a54-6c8a-4db5-ab64-37ab2f93c167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:14 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f (7404b3fe-263e-46e9-8d9d-0c44c2eab48f): created successfully Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167e1a54-6c8a-4db5-ab64-37ab2f93c167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (fa758dfb-a5af-467c-a395-303177a81a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:14 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-57a46afe-3864-4dc6-bf8b-3d0ec89ca7b3 tempest-CreateVolumesFromSnapshotTest-348720364 None] Created volume successfully. Apr 24 19:24:15 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3 1073741824" returned: 0 in 0.638s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:15 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3 Apr 24 19:24:15 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:16 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3" returned: 0 in 0.462s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.497s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-763464326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c993de6-5481-40bd-ab44-5d8b2f305398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0685db7a86d44eeb18a0d5c905a787a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:12Z,use_quota=True,user_id='96ac8f1d8ca24d6ab5d4092b02ad75d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Creating volume 6c993de6-5481-40bd-ab44-5d8b2f305398 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:16 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917098cc-61ed-4efd-9fba-62ebe76e2e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76d47f5-75b1-4740-90de-934f140511a3', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:16 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398 1073741824 Apr 24 19:24:16 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fa7d5c-05b7-439d-953c-5ef2cf9b2e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:16 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume volume-d76d47f5-75b1-4740-90de-934f140511a3 (d76d47f5-75b1-4740-90de-934f140511a3): created successfully Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fa7d5c-05b7-439d-953c-5ef2cf9b2e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (3b1036d4-73ff-4618-bf44-685e5c60d9d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:16 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-f42e049e-6b20-4b50-9dd7-da6c81490d46 tempest-CreateVolumesFromSnapshotTest-348720364 None] Created volume successfully. Apr 24 19:24:16 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398 1073741824" returned: 0 in 0.648s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:16 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398 Apr 24 19:24:16 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:17 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398" returned: 0 in 0.431s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33aa20f8-e6e2-4bdf-b193-aced3d9fccd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c993de6-5481-40bd-ab44-5d8b2f305398', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f43eac-ac55-4144-bb92-4bc8f466d581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:17 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Volume volume-6c993de6-5481-40bd-ab44-5d8b2f305398 (6c993de6-5481-40bd-ab44-5d8b2f305398): created successfully Apr 24 19:24:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f43eac-ac55-4144-bb92-4bc8f466d581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Flow 'volume_create_manager' (e3a755da-f653-497f-bdcf-895f7216bd49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:17 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6414b597-f07a-443f-be56-a419f654a366 tempest-CreateVolumesFromSnapshotTest-348720364 None] Created volume successfully. Apr 24 19:24:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-6c993de6-5481-40bd-ab44-5d8b2f305398-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-6c993de6-5481-40bd-ab44-5d8b2f305398-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-quobyte-6c993de6-5481-40bd-ab44-5d8b2f305398" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-6c993de6-5481-40bd-ab44-5d8b2f305398" acquired by "delete_volume" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:18 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[3733d17c-da29-43c9-b7fd-2647f3c4238d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:18 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398 Apr 24 19:24:18 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:18 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398" returned: 0 in 0.529s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:18 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398 Apr 24 19:24:18 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:19 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6c993de6-5481-40bd-ab44-5d8b2f305398" returned: 0 in 0.439s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-6c993de6-5481-40bd-ab44-5d8b2f305398" released by "delete_volume" :: held 1.007s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Created reservations ['0731ac85-0c35-4a1f-8824-12f079a3e26b', '2d3c5034-3535-4346-89ae-d759ea06ff8d', 'd2b8abb6-eb50-439a-a898-ae95b6626fce', 'abaf9771-573a-44d5-86f3-e991ff549abf'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:19 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:24:19 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:19 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.447s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:19 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Deleted volume successfully. Apr 24 19:24:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-08ab053b-a2a9-4d32-b3c5-a9950d519bf0 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-6c993de6-5481-40bd-ab44-5d8b2f305398-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-d76d47f5-75b1-4740-90de-934f140511a3-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-d76d47f5-75b1-4740-90de-934f140511a3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-quobyte-d76d47f5-75b1-4740-90de-934f140511a3" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-d76d47f5-75b1-4740-90de-934f140511a3" acquired by "delete_volume" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:20 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fedf06-0735-40e5-aa7c-03db379af9ee]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:20 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3 Apr 24 19:24:20 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:20 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3" returned: 0 in 0.572s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:21 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3 Apr 24 19:24:21 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:21 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d76d47f5-75b1-4740-90de-934f140511a3" returned: 0 in 0.518s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-d76d47f5-75b1-4740-90de-934f140511a3" released by "delete_volume" :: held 1.136s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:21 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Created reservations ['4fb33068-3490-42bb-a577-8a452dfe9601', 'f5654c1a-78d8-4e1d-8a4e-796433777db7', '778687d8-f77c-4353-b7ba-b6a9ad9f3176', 'a6a3c9c5-1b78-40d5-97b7-705dd33866d9'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:21 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:24:21 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:22 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.535s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:22 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:22 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Deleted volume successfully. Apr 24 19:24:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-db844426-9352-4f55-bb00-98b0f5e4e1f6 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-d76d47f5-75b1-4740-90de-934f140511a3-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-7404b3fe-263e-46e9-8d9d-0c44c2eab48f-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-7404b3fe-263e-46e9-8d9d-0c44c2eab48f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-quobyte-7404b3fe-263e-46e9-8d9d-0c44c2eab48f" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-7404b3fe-263e-46e9-8d9d-0c44c2eab48f" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:22 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43da5e7-7b24-4e6b-a0e7-4506f07488cf]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:22 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f Apr 24 19:24:22 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:23 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f" returned: 0 in 0.650s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:23 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f Apr 24 19:24:23 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:23 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-7404b3fe-263e-46e9-8d9d-0c44c2eab48f" returned: 0 in 0.475s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-7404b3fe-263e-46e9-8d9d-0c44c2eab48f" released by "delete_volume" :: held 1.187s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:23 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Created reservations ['cb6688e1-35a7-4432-9f6b-6d6d64762523', '8eaf842c-6091-4bbc-b910-cc85bcf9e8ff', '72fa7018-9803-4fd2-8ed5-83ac88b2c543', 'd90e0a74-2812-4faf-a441-706d7ef8d8f4'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:23 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:23 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:23 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:24:24 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:24 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.456s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:24 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:24 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Deleted volume successfully. Apr 24 19:24:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4d738699-2549-4511-8359-6d2f49c2d187 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-7404b3fe-263e-46e9-8d9d-0c44c2eab48f-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-b6a05b13-5ecc-4ec4-9325-25462cfaa2af-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-b6a05b13-5ecc-4ec4-9325-25462cfaa2af-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-quobyte-b6a05b13-5ecc-4ec4-9325-25462cfaa2af" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-b6a05b13-5ecc-4ec4-9325-25462cfaa2af" acquired by "delete_volume" :: waited 0.023s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:24 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a519db44-8ec0-4808-a56d-ba0fd0cc0a6b]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:25 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af Apr 24 19:24:25 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:25 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af" returned: 0 in 0.541s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:25 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af Apr 24 19:24:25 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:25 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-b6a05b13-5ecc-4ec4-9325-25462cfaa2af" returned: 0 in 0.464s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-b6a05b13-5ecc-4ec4-9325-25462cfaa2af" released by "delete_volume" :: held 1.052s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:26 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Created reservations ['d7f478c6-c172-4cba-895d-4c9df2b626f1', 'da4cb2b6-2c87-455b-b390-9c64a5a60305', '12468145-ab4b-4785-8861-e14165146551', 'e3f14915-64a4-4d2e-ba81-723876b9bf58'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:26 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:24:26 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:26 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.468s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:26 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:26 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Deleted volume successfully. Apr 24 19:24:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cfe8d8a5-78a8-47cd-b22e-d0e54e8a8289 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-b6a05b13-5ecc-4ec4-9325-25462cfaa2af-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-quobyte-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a" acquired by "delete_volume" :: waited 0.014s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:27 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c532ac-eddf-4a0c-b27b-2467c64cbc78]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:27 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a Apr 24 19:24:27 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:27 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a" returned: 0 in 0.594s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:27 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a Apr 24 19:24:27 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:28 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a" returned: 0 in 0.492s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a" released by "delete_volume" :: held 1.128s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Created reservations ['5e20e0eb-e178-4a2f-a201-3670e51c0ef9', '46093ea1-9e21-4550-8cae-c69d0479d921', '7ddfcb62-49d8-49bb-bb50-c258b3f57424', 'a45ba1fc-0c2d-4696-ab15-21518b21f4a9'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:28 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:24:28 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:28 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.472s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Deleted volume successfully. Apr 24 19:24:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-3b678df2-6cd9-4c86-b825-a8146b33f96f tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-60e2632b-0ff5-41bb-8ae7-c7ffd0a79b1a-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-40df6d5a-9dc7-48c4-967e-89585a3086a7-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-40df6d5a-9dc7-48c4-967e-89585a3086a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-quobyte-62ea1c5c-6e30-4258-88ee-057f7ca562ff" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-62ea1c5c-6e30-4258-88ee-057f7ca562ff" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-quobyte-40df6d5a-9dc7-48c4-967e-89585a3086a7" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-40df6d5a-9dc7-48c4-967e-89585a3086a7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Deleting offline snapshot 40df6d5a-9dc7-48c4-967e-89585a3086a7 of volume 62ea1c5c-6e30-4258-88ee-057f7ca562ff {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:24:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] snapshot_file for this snap is: volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:24:29 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dffc23-a301-45d1-8492-878a8b033242]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:29 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 Apr 24 19:24:29 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:30 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7" returned: 0 in 0.584s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:24:30 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04c333a-f34c-415c-b8d3-c50d3e434cf8]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:30 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff Apr 24 19:24:30 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:30 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff" returned: 0 in 0.608s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:30 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 Apr 24 19:24:30 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:31 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7" returned: 0 in 0.607s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:31 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7 Apr 24 19:24:31 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:31 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff.40df6d5a-9dc7-48c4-967e-89585a3086a7" returned: 0 in 0.491s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-40df6d5a-9dc7-48c4-967e-89585a3086a7" released by "_delete_snapshot" :: held 2.400s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-62ea1c5c-6e30-4258-88ee-057f7ca562ff" released by "delete_snapshot" :: held 2.423s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:31 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Created reservations ['eccebc22-4663-4416-853a-0c175d2c0651', '96a36874-5555-446d-aef8-3edf5264d6fd', '0e93c4d4-78b4-462b-92ef-8ca738e78d2d', 'b4ac1f8c-3c52-4e02-9097-1d805b811ea1'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:31 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Delete snapshot completed successfully. Apr 24 19:24:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b0a9adab-b47a-4581-9e7c-c2f72a7ce866 tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-40df6d5a-9dc7-48c4-967e-89585a3086a7-delete_snapshot" released by "delete_snapshot" :: held 2.584s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-62ea1c5c-6e30-4258-88ee-057f7ca562ff-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-62ea1c5c-6e30-4258-88ee-057f7ca562ff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "cinder-quobyte-62ea1c5c-6e30-4258-88ee-057f7ca562ff" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-62ea1c5c-6e30-4258-88ee-057f7ca562ff" acquired by "delete_volume" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:32 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc82387-1f81-49af-853a-20bebc8f1ead]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:32 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff Apr 24 19:24:32 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:33 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff" returned: 0 in 0.582s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:33 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff Apr 24 19:24:33 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:33 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-62ea1c5c-6e30-4258-88ee-057f7ca562ff" returned: 0 in 0.490s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-quobyte-62ea1c5c-6e30-4258-88ee-057f7ca562ff" released by "delete_volume" :: held 1.131s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:33 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Created reservations ['66f05102-c500-44c5-b618-95df552ce48f', '00d55851-8f93-4470-a779-9f988dce53ae', 'cc984f35-c328-4b6c-a1a2-cf8b7d6bca95', '4ae6ea38-82d9-4398-9487-02926b5831b0'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:33 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:24:33 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:34 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.463s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:34 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:34 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Deleted volume successfully. Apr 24 19:24:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ceb00155-6b2b-472d-9fbd-a7c9975892dd tempest-CreateVolumesFromSnapshotTest-348720364 None] Lock "cinder-62ea1c5c-6e30-4258-88ee-057f7ca562ff-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Flow 'volume_create_manager' (ff4cf426-e29b-46ab-ad64-b9ace70a28a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e788a30-207d-4948-b69a-99a8b518916c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e788a30-207d-4948-b69a-99a8b518916c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae767f65-6fcf-4402-ac2b-f9eddfd5714e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685bdebd20ba42a1aada46738e97106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:38Z,use_quota=True,user_id='cdee082f551a4107ba2215aa23ea033b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376431e0-9539-4f28-8cc8-c05fb70ebd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376431e0-9539-4f28-8cc8-c05fb70ebd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e3ed9c-f322-409b-b650-8270a4f7517b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e3ed9c-f322-409b-b650-8270a4f7517b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae767f65-6fcf-4402-ac2b-f9eddfd5714e', 'volume_name': 'volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5666560-c338-4604-82ab-9aeffeef5744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5666560-c338-4604-82ab-9aeffeef5744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a840d990-9eb5-4131-aefa-950c3334034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:37 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Volume ae767f65-6fcf-4402-ac2b-f9eddfd5714e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e', 'volume_size': 1} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae767f65-6fcf-4402-ac2b-f9eddfd5714e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685bdebd20ba42a1aada46738e97106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:38Z,use_quota=True,user_id='cdee082f551a4107ba2215aa23ea033b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Creating volume ae767f65-6fcf-4402-ac2b-f9eddfd5714e {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:37 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:24:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:37 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e 1073741824 Apr 24 19:24:37 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:38 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e 1073741824" returned: 0 in 0.652s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:38 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e Apr 24 19:24:38 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:39 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e" returned: 0 in 0.428s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:39 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:39 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a840d990-9eb5-4131-aefa-950c3334034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:39 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3cc898-ec8e-49fe-98ad-271236ed682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:40 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Volume volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e (ae767f65-6fcf-4402-ac2b-f9eddfd5714e): created successfully Apr 24 19:24:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3cc898-ec8e-49fe-98ad-271236ed682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Flow 'volume_create_manager' (ff4cf426-e29b-46ab-ad64-b9ace70a28a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:40 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-badb448f-b22b-437e-91bf-30d72279a0d2 tempest-CinderUnicodeTest-361784543 None] Created volume successfully. Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Flow 'volume_create_manager' (c4593423-29cc-434e-b00b-6b39f499038f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd5097b-f2b5-4796-be71-18d1e1cfbce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd5097b-f2b5-4796-be71-18d1e1cfbce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-40682416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678d038f-c5a6-453a-90a5-5babafd66b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685bdebd20ba42a1aada46738e97106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:44Z,use_quota=True,user_id='cdee082f551a4107ba2215aa23ea033b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a30dfd1-a6a8-4ce0-98a0-354c71e82445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a30dfd1-a6a8-4ce0-98a0-354c71e82445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e089e8-8029-4948-8fe2-f49c8cb1958e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e089e8-8029-4948-8fe2-f49c8cb1958e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '678d038f-c5a6-453a-90a5-5babafd66b33', 'volume_name': 'volume-678d038f-c5a6-453a-90a5-5babafd66b33', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c48b90-0a6d-4897-9344-2476d0fb5313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c48b90-0a6d-4897-9344-2476d0fb5313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88af50b-0d65-45aa-8c38-5854392153be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:43 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Volume 678d038f-c5a6-453a-90a5-5babafd66b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-678d038f-c5a6-453a-90a5-5babafd66b33', 'volume_size': 1} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:24:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-40682416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678d038f-c5a6-453a-90a5-5babafd66b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685bdebd20ba42a1aada46738e97106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:24:44Z,use_quota=True,user_id='cdee082f551a4107ba2215aa23ea033b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Creating volume 678d038f-c5a6-453a-90a5-5babafd66b33 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:24:43 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:24:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:43 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 1073741824 Apr 24 19:24:43 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:44 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 1073741824" returned: 0 in 0.657s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:44 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 Apr 24 19:24:44 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:45 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33" returned: 0 in 0.434s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:24:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88af50b-0d65-45aa-8c38-5854392153be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678d038f-c5a6-453a-90a5-5babafd66b33', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfa4694-e943-4a74-a480-7e260438828c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:24:45 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Volume volume-678d038f-c5a6-453a-90a5-5babafd66b33 (678d038f-c5a6-453a-90a5-5babafd66b33): created successfully Apr 24 19:24:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfa4694-e943-4a74-a480-7e260438828c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:24:45 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Flow 'volume_create_manager' (c4593423-29cc-434e-b00b-6b39f499038f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:24:45 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d71a2c55-87d9-4006-8853-eaab3c5f116b tempest-CinderUnicodeTest-361784543 None] Created volume successfully. Apr 24 19:24:46 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=105,cinder:INSERT=35,cinder:UPDATE=135,cinder:DELETE=10 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:24:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:46 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] Creating offline snapshot 1e8de917-3364-4c44-a6df-475bd6e91f8d of volume 678d038f-c5a6-453a-90a5-5babafd66b33 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:24:46 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[58db1436-4a10-417f-b059-9a0946e0abfc]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:46 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 Apr 24 19:24:46 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:46 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33" returned: 0 in 0.590s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:46 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d 1G Apr 24 19:24:46 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:47 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d 1G" returned: 0 in 0.642s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678d038f-c5a6-453a-90a5-5babafd66b33 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:47 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678d038f-c5a6-453a-90a5-5babafd66b33 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d Apr 24 19:24:47 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:48 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-678d038f-c5a6-453a-90a5-5babafd66b33 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d" returned: 0 in 0.514s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:48 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d is being set with open permissions: ugo+rw Apr 24 19:24:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:48 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d Apr 24 19:24:48 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:48 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d" returned: 0 in 0.462s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:48 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.info Apr 24 19:24:48 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:49 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.info" returned: 0 in 0.438s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:49 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.info is being set with open permissions: ugo+rw Apr 24 19:24:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:49 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.info Apr 24 19:24:49 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:49 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.info" returned: 0 in 0.451s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.188s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:49 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-da0f0da3-4a43-4fb6-b66f-378c0820b16e tempest-CinderUnicodeTest-361784543 None] Create snapshot completed successfully Apr 24 19:24:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Acquiring lock "cinder-1e8de917-3364-4c44-a6df-475bd6e91f8d-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Lock "cinder-1e8de917-3364-4c44-a6df-475bd6e91f8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Acquiring lock "cinder-quobyte-678d038f-c5a6-453a-90a5-5babafd66b33" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Lock "cinder-quobyte-678d038f-c5a6-453a-90a5-5babafd66b33" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Acquiring lock "cinder-quobyte-1e8de917-3364-4c44-a6df-475bd6e91f8d" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Lock "cinder-quobyte-1e8de917-3364-4c44-a6df-475bd6e91f8d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Deleting offline snapshot 1e8de917-3364-4c44-a6df-475bd6e91f8d of volume 678d038f-c5a6-453a-90a5-5babafd66b33 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:24:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] snapshot_file for this snap is: volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:24:50 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d896b6-9dea-4c23-b800-01311a9ccd77]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:50 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d Apr 24 19:24:50 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:51 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d" returned: 0 in 0.551s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-678d038f-c5a6-453a-90a5-5babafd66b33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:24:51 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[d145cdd4-4cba-4f79-a6d0-bde42fa17627]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:51 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 Apr 24 19:24:51 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:51 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33" returned: 0 in 0.555s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:51 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d Apr 24 19:24:51 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:52 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d" returned: 0 in 0.559s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:52 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d Apr 24 19:24:52 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:52 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:52 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33.1e8de917-3364-4c44-a6df-475bd6e91f8d" returned: 0 in 0.482s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Lock "cinder-quobyte-1e8de917-3364-4c44-a6df-475bd6e91f8d" released by "_delete_snapshot" :: held 2.257s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Lock "cinder-quobyte-678d038f-c5a6-453a-90a5-5babafd66b33" released by "delete_snapshot" :: held 2.288s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:52 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Created reservations ['e7fd7241-d782-43ab-8707-f5bdc0aeb3f0', 'f5eb8733-0181-4464-9ebf-2cdf3579c820', '351acc64-9d6e-492f-9add-e066acbdfb60', '165da670-948f-4dfc-b4db-b895e0b0d201'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:52 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Delete snapshot completed successfully. Apr 24 19:24:52 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-fa5e9c85-7469-4fd6-904e-cf2ff085aa1e tempest-CinderUnicodeTest-361784543 None] Lock "cinder-1e8de917-3364-4c44-a6df-475bd6e91f8d-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Acquiring lock "cinder-678d038f-c5a6-453a-90a5-5babafd66b33-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Lock "cinder-678d038f-c5a6-453a-90a5-5babafd66b33-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Acquiring lock "cinder-quobyte-678d038f-c5a6-453a-90a5-5babafd66b33" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:53 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Lock "cinder-quobyte-678d038f-c5a6-453a-90a5-5babafd66b33" acquired by "delete_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:53 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[4955f844-9bc4-4cd0-9b78-99b5f5d9b429]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:53 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:53 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 Apr 24 19:24:53 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:54 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33" returned: 0 in 0.578s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:54 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33 Apr 24 19:24:54 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:54 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:54 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-678d038f-c5a6-453a-90a5-5babafd66b33" returned: 0 in 0.468s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:54 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Lock "cinder-quobyte-678d038f-c5a6-453a-90a5-5babafd66b33" released by "delete_volume" :: held 1.108s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:54 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Created reservations ['d09bee15-ab4f-4c0a-aa16-ee4ed317bc49', 'ba6b2f2a-852f-4347-bb13-7c0aec24c2f6', 'b1ced423-ff72-4aff-ad02-0db52efac35c', '764a2e52-cf34-4b49-9366-46e2c9ebb63a'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:55 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:55 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:24:55 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:55 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:55 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.467s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:55 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:55 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Deleted volume successfully. Apr 24 19:24:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e097b030-b2c3-4292-a10e-e546158ef14d tempest-CinderUnicodeTest-361784543 None] Lock "cinder-678d038f-c5a6-453a-90a5-5babafd66b33-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Acquiring lock "cinder-ae767f65-6fcf-4402-ac2b-f9eddfd5714e-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:55 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Lock "cinder-ae767f65-6fcf-4402-ac2b-f9eddfd5714e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Acquiring lock "cinder-quobyte-ae767f65-6fcf-4402-ac2b-f9eddfd5714e" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:24:56 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Lock "cinder-quobyte-ae767f65-6fcf-4402-ac2b-f9eddfd5714e" acquired by "delete_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:24:56 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae4e1b1-6509-4214-a2e6-1417c58c1ef5]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:24:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:56 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e Apr 24 19:24:56 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:56 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e" returned: 0 in 0.569s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:56 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e Apr 24 19:24:56 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:57 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ae767f65-6fcf-4402-ac2b-f9eddfd5714e" returned: 0 in 0.438s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Lock "cinder-quobyte-ae767f65-6fcf-4402-ac2b-f9eddfd5714e" released by "delete_volume" :: held 1.051s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Created reservations ['d947c729-39d5-4b6d-a207-c08c9e0cab56', '822a79fe-d49e-4c8a-bac1-107f98ef35e2', 'b5735916-6244-4aa7-b2de-53985f057180', '3ec39029-243c-4721-9c82-ed463b8c6b6f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:57 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:24:57 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:57 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.439s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:24:57 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Deleted volume successfully. Apr 24 19:24:57 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-412d82fc-4f71-4b05-bb7a-b161596b08b3 tempest-CinderUnicodeTest-361784543 None] Lock "cinder-ae767f65-6fcf-4402-ac2b-f9eddfd5714e-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:24:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:24:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:24:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:24:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:24:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:24:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:24:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:24:58 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:24:58 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:24:58 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 24 19:24:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.502s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:24:58 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (cd12ac02-1491-4674-ada3-9d9c418cc494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad56540-a1da-4f91-8898-b743818c1835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad56540-a1da-4f91-8898-b743818c1835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1606941312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414a04e8-5274-4fe9-825d-74f620f69cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:07Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd05ea2-ec7a-4ec0-896a-e37c71203c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd05ea2-ec7a-4ec0-896a-e37c71203c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b686ab3-0680-4532-8688-848b9fe9f739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b686ab3-0680-4532-8688-848b9fe9f739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414a04e8-5274-4fe9-825d-74f620f69cf4', 'volume_name': 'volume-414a04e8-5274-4fe9-825d-74f620f69cf4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754af7f2-7c4b-4fb8-a727-c970926d1095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (754af7f2-7c4b-4fb8-a727-c970926d1095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74ed0b3-e82f-4110-8d49-9dcea0686b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume 414a04e8-5274-4fe9-825d-74f620f69cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414a04e8-5274-4fe9-825d-74f620f69cf4', 'volume_size': 1} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1606941312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414a04e8-5274-4fe9-825d-74f620f69cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:07Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Creating volume 414a04e8-5274-4fe9-825d-74f620f69cf4 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:07 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:07 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4 1073741824 Apr 24 19:25:07 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Flow 'volume_create_manager' (68acd307-860e-4d7c-a6ff-dc3a98f53a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f8c949-dd1f-47b4-9514-5999e91fc42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f8c949-dd1f-47b4-9514-5999e91fc42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-749836370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6a9fe1-e25d-477f-96f5-d6fed256ca6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73acb25e690c436088f2891416b8afd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:07Z,use_quota=True,user_id='d6ad4017216a4f64a378ed9d7bef46d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c1f295-23fe-44ed-bc1c-7f7c61306c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c1f295-23fe-44ed-bc1c-7f7c61306c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccccdb9-4347-4e93-ac08-1895c18933c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccccdb9-4347-4e93-ac08-1895c18933c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6a9fe1-e25d-477f-96f5-d6fed256ca6e', 'volume_name': 'volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1eca8e-f959-43b6-86b6-19a704be574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1eca8e-f959-43b6-86b6-19a704be574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9e4831-5235-458b-8df2-558b12058bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Volume 3e6a9fe1-e25d-477f-96f5-d6fed256ca6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e', 'volume_size': 1} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Flow 'volume_create_manager' (fcf85723-a76d-4ffd-9936-13960995caba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d5314-d3c0-4e4d-817c-d51c7b933e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (909d5314-d3c0-4e4d-817c-d51c7b933e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-61628723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e4186f-3d02-4919-972e-e1bc59dd9ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d36190d4514595800365ba25369512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:07Z,use_quota=True,user_id='1d8fe3eed0cf42fc8daecfd0353c051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f322e7-eecc-4e3c-82dd-c18f7cd017f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f322e7-eecc-4e3c-82dd-c18f7cd017f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c66e681-ce17-4fd1-8978-24cc621e3737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c66e681-ce17-4fd1-8978-24cc621e3737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e4186f-3d02-4919-972e-e1bc59dd9ac4', 'volume_name': 'volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32aa359-75f7-4f78-9aad-733d92d432f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32aa359-75f7-4f78-9aad-733d92d432f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda0178f-8128-4456-a774-ae3809be3b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:07 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Volume a3e4186f-3d02-4919-972e-e1bc59dd9ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4', 'volume_size': 1} Apr 24 19:25:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Flow 'volume_create_manager' (0b1643c7-8e33-4e4a-8531-ddfc1f7b7df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ab3ab5-8df1-43c4-a498-cd6eec1286cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ab3ab5-8df1-43c4-a498-cd6eec1286cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1473079697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64bc846d-d47e-443e-b7e4-bdb9ad87c0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d36190d4514595800365ba25369512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:08Z,use_quota=True,user_id='1d8fe3eed0cf42fc8daecfd0353c051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d31ad7-7b28-4a7b-84de-d219bf1029a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d31ad7-7b28-4a7b-84de-d219bf1029a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd73407d-1b23-4892-8c9f-c9dfad26af36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd73407d-1b23-4892-8c9f-c9dfad26af36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64bc846d-d47e-443e-b7e4-bdb9ad87c0de', 'volume_name': 'volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f3a5c1-3a96-441c-b3e1-dca1098b2ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f3a5c1-3a96-441c-b3e1-dca1098b2ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688859fb-94e6-42eb-b66c-126e11c71b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Volume 64bc846d-d47e-443e-b7e4-bdb9ad87c0de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de', 'volume_size': 1} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:08 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4 1073741824" returned: 0 in 1.064s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:08 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4 Apr 24 19:25:08 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Flow 'volume_create_manager' (212d6959-92b7-4719-8a2c-cc2bfcb939fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6144f3-307a-4b0d-a3de-cb4206c45195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6144f3-307a-4b0d-a3de-cb4206c45195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1371006964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d946f148-b8ee-4d2a-821f-e7cdc5dc031f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d36190d4514595800365ba25369512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:08Z,use_quota=True,user_id='1d8fe3eed0cf42fc8daecfd0353c051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5269b31c-3954-4b2b-9fb1-e26026c791be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5269b31c-3954-4b2b-9fb1-e26026c791be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb82524-824e-406d-8d6b-60ed37fe78ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb82524-824e-406d-8d6b-60ed37fe78ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd946f148-b8ee-4d2a-821f-e7cdc5dc031f', 'volume_name': 'volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178b8c20-e4f4-4086-a282-22857fd693df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178b8c20-e4f4-4086-a282-22857fd693df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ecdee8-2d10-46c3-befe-e21c3c080e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Volume d946f148-b8ee-4d2a-821f-e7cdc5dc031f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f', 'volume_size': 1} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Flow 'volume_create_manager' (0721425e-433a-4911-874b-529cb0dfeadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72a7d97-ccbb-4497-834c-82999b7bb71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72a7d97-ccbb-4497-834c-82999b7bb71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1812103247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1c8205-f7b0-4194-9ca3-774895d51da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d36190d4514595800365ba25369512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:09Z,use_quota=True,user_id='1d8fe3eed0cf42fc8daecfd0353c051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3315884e-3cf9-479c-b745-e9cd471c834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3315884e-3cf9-479c-b745-e9cd471c834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de07808-f241-4105-b95f-49166c355e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de07808-f241-4105-b95f-49166c355e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1c8205-f7b0-4194-9ca3-774895d51da5', 'volume_name': 'volume-6d1c8205-f7b0-4194-9ca3-774895d51da5', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332b37e5-6011-49d2-9ab1-aa5ec6307f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (332b37e5-6011-49d2-9ab1-aa5ec6307f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48280977-7dac-48aa-be7b-2406cf84bea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:08 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Volume 6d1c8205-f7b0-4194-9ca3-774895d51da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1c8205-f7b0-4194-9ca3-774895d51da5', 'volume_size': 1} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:08 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4" returned: 0 in 0.647s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-749836370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6a9fe1-e25d-477f-96f5-d6fed256ca6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73acb25e690c436088f2891416b8afd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:07Z,use_quota=True,user_id='d6ad4017216a4f64a378ed9d7bef46d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Creating volume 3e6a9fe1-e25d-477f-96f5-d6fed256ca6e {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:09 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:09 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e 1073741824 Apr 24 19:25:09 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74ed0b3-e82f-4110-8d49-9dcea0686b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414a04e8-5274-4fe9-825d-74f620f69cf4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86b98fd-19aa-4429-8986-c309244e17ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Flow 'volume_create_manager' (ec9b4b9e-e8ea-4d22-95df-fda777b9b183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acc8d80-e0e4-4bdc-977f-bcdd5a8babe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume volume-414a04e8-5274-4fe9-825d-74f620f69cf4 (414a04e8-5274-4fe9-825d-74f620f69cf4): created successfully Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86b98fd-19aa-4429-8986-c309244e17ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (cd12ac02-1491-4674-ada3-9d9c418cc494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acc8d80-e0e4-4bdc-977f-bcdd5a8babe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2118869839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438cb6ba-cfc7-4388-8feb-9e240375a8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d36190d4514595800365ba25369512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:09Z,use_quota=True,user_id='1d8fe3eed0cf42fc8daecfd0353c051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089bfb4c-2714-4676-93d9-b50f0062d279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089bfb4c-2714-4676-93d9-b50f0062d279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae109144-7f82-4bbe-b445-3f3259b576f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae109144-7f82-4bbe-b445-3f3259b576f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438cb6ba-cfc7-4388-8feb-9e240375a8ed', 'volume_name': 'volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d9914a-a212-49c8-ba78-ad56d50d3648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d9914a-a212-49c8-ba78-ad56d50d3648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f51697-92fa-4d98-8fe8-6bc53ea53ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Volume 438cb6ba-cfc7-4388-8feb-9e240375a8ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed', 'volume_size': 1} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:09 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-930ef3eb-abee-4775-8375-d4c8f6025d01 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created volume successfully. Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (0ea9b33d-4e65-4672-b7aa-2fc0d3d5c46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420756f7-ef05-41e8-b3ee-1969a2ca858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420756f7-ef05-41e8-b3ee-1969a2ca858b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1653773124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2a9c9a-a466-4165-8864-3f30e494bcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:10Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fe5843-ef7a-4e69-be73-8b14e8925dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fe5843-ef7a-4e69-be73-8b14e8925dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba88770e-56da-4bbb-ac80-4b5f019128c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba88770e-56da-4bbb-ac80-4b5f019128c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2a9c9a-a466-4165-8864-3f30e494bcf3', 'volume_name': 'volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e859385-10ae-4d7d-a29d-5fa4c057b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e859385-10ae-4d7d-a29d-5fa4c057b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9a081b-2cc5-4c98-b48e-4ad88558af61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:09 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume fc2a9c9a-a466-4165-8864-3f30e494bcf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3', 'volume_size': 1} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:09 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e 1073741824" returned: 0 in 0.831s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=77,cinder:UPDATE=107,cinder:INSERT=26,cinder:DELETE=10 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:25:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:09 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e Apr 24 19:25:09 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (76239aec-7748-4a68-a8f5-474ec49d7b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180d3538-1fb2-441b-8c06-07feb6e7449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180d3538-1fb2-441b-8c06-07feb6e7449d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-954543788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b86ae4f-03f5-49b4-8eb9-40f04575cf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:10Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f54261-fba3-45d9-96a9-ba451134c36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f54261-fba3-45d9-96a9-ba451134c36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2f8b47-21c8-4900-8c0f-513b0c9342c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2f8b47-21c8-4900-8c0f-513b0c9342c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b86ae4f-03f5-49b4-8eb9-40f04575cf4c', 'volume_name': 'volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c18e8d-0f0d-4754-8083-5f059b549a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c18e8d-0f0d-4754-8083-5f059b549a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f21263c-fa17-4245-8c19-b5ba8eebd941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume 6b86ae4f-03f5-49b4-8eb9-40f04575cf4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c', 'volume_size': 1} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:10 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (4378908e-95d6-49d9-a58c-14076a83d7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d8e6f5-380f-471e-873f-cc100526a0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" returned: 0 in 0.562s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.750s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-61628723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e4186f-3d02-4919-972e-e1bc59dd9ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d36190d4514595800365ba25369512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:07Z,use_quota=True,user_id='1d8fe3eed0cf42fc8daecfd0353c051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Creating volume a3e4186f-3d02-4919-972e-e1bc59dd9ac4 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:10 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d8e6f5-380f-471e-873f-cc100526a0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-126836313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80446c52-0a25-48fa-8dd9-9febfd24ae54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:10Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade81eb1-272a-407c-a4af-c6311d341225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4 1073741824 Apr 24 19:25:10 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade81eb1-272a-407c-a4af-c6311d341225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b15a133-c69a-43e2-bcc5-5cd04c0e2a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b15a133-c69a-43e2-bcc5-5cd04c0e2a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80446c52-0a25-48fa-8dd9-9febfd24ae54', 'volume_name': 'volume-80446c52-0a25-48fa-8dd9-9febfd24ae54', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab79a256-0d89-4395-9e26-6a1da50907a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab79a256-0d89-4395-9e26-6a1da50907a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c27edf1-3978-45e9-8999-2142892b8350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume 80446c52-0a25-48fa-8dd9-9febfd24ae54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80446c52-0a25-48fa-8dd9-9febfd24ae54', 'volume_size': 1} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9e4831-5235-458b-8df2-558b12058bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7da27e7-d611-4e13-a0bc-308012ec81a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Volume volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e (3e6a9fe1-e25d-477f-96f5-d6fed256ca6e): created successfully Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7da27e7-d611-4e13-a0bc-308012ec81a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Flow 'volume_create_manager' (68acd307-860e-4d7c-a6ff-dc3a98f53a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:10 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e8459810-3c7d-4769-a424-27d0423fb2a0 tempest-VolumeDependencyTests-1446922614 None] Created volume successfully. Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (072f134e-1f4d-48fe-a5c2-abbc3a1e4ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b24e293-7654-4852-adc5-a58513b533ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b24e293-7654-4852-adc5-a58513b533ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1149157122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a0d789-74a4-4217-989a-415c79527cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:11Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f30985-21b2-427a-8c6d-f43eb2666866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f30985-21b2-427a-8c6d-f43eb2666866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d476be-11af-4073-8cc2-c62870da1f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d476be-11af-4073-8cc2-c62870da1f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a0d789-74a4-4217-989a-415c79527cc8', 'volume_name': 'volume-16a0d789-74a4-4217-989a-415c79527cc8', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9602c0ff-ce37-42e3-a8a3-a918551e9a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9602c0ff-ce37-42e3-a8a3-a918551e9a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75185850-6e01-455d-9171-6beb5ce66a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:10 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume 16a0d789-74a4-4217-989a-415c79527cc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a0d789-74a4-4217-989a-415c79527cc8', 'volume_size': 1} Apr 24 19:25:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (c5cb0ef1-5951-4660-be15-851dfa463722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af03706e-5c3e-4435-ac89-b1ae85ea3c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af03706e-5c3e-4435-ac89-b1ae85ea3c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-335205573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86fc6d40-ef0e-44be-9764-c493a665511b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:11Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b08a5e-a66e-4368-9146-3cea352bd1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b08a5e-a66e-4368-9146-3cea352bd1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0ff427-a2be-4ef4-8b6b-d2a0cd99b4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0ff427-a2be-4ef4-8b6b-d2a0cd99b4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86fc6d40-ef0e-44be-9764-c493a665511b', 'volume_name': 'volume-86fc6d40-ef0e-44be-9764-c493a665511b', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea187a4c-b437-4dbb-ad43-5ada10c5d841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea187a4c-b437-4dbb-ad43-5ada10c5d841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6966a61d-5e80-4c6a-808a-17833033aa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:11 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume 86fc6d40-ef0e-44be-9764-c493a665511b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86fc6d40-ef0e-44be-9764-c493a665511b', 'volume_size': 1} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:11 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4 1073741824" returned: 0 in 0.893s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:11 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4 Apr 24 19:25:11 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:11 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4" returned: 0 in 0.581s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.828s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1473079697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64bc846d-d47e-443e-b7e4-bdb9ad87c0de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d36190d4514595800365ba25369512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:08Z,use_quota=True,user_id='1d8fe3eed0cf42fc8daecfd0353c051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Creating volume 64bc846d-d47e-443e-b7e4-bdb9ad87c0de {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:12 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda0178f-8128-4456-a774-ae3809be3b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20945dc6-235b-4cf8-b3fd-f3ff8bdbad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:12 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de 1073741824 Apr 24 19:25:12 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:12 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Volume volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4 (a3e4186f-3d02-4919-972e-e1bc59dd9ac4): created successfully Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20945dc6-235b-4cf8-b3fd-f3ff8bdbad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Flow 'volume_create_manager' (fcf85723-a76d-4ffd-9936-13960995caba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:12 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4c6dff27-b41c-4c42-b77e-7cb090c8de55 tempest-CreateVolumesFromImageTest-1505476382 None] Created volume successfully. Apr 24 19:25:12 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de 1073741824" returned: 0 in 0.797s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:12 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de Apr 24 19:25:12 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:13 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de" returned: 0 in 0.512s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.866s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1371006964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d946f148-b8ee-4d2a-821f-e7cdc5dc031f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d36190d4514595800365ba25369512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:08Z,use_quota=True,user_id='1d8fe3eed0cf42fc8daecfd0353c051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Creating volume d946f148-b8ee-4d2a-821f-e7cdc5dc031f {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:13 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:13 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f 1073741824 Apr 24 19:25:13 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688859fb-94e6-42eb-b66c-126e11c71b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23291814-875f-4622-97e2-37e6979f26d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:13 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Volume volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de (64bc846d-d47e-443e-b7e4-bdb9ad87c0de): created successfully Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23291814-875f-4622-97e2-37e6979f26d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:13 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Flow 'volume_create_manager' (0b1643c7-8e33-4e4a-8531-ddfc1f7b7df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:13 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-55d95cde-3275-446e-a3db-59639631a872 tempest-CreateVolumesFromImageTest-1505476382 None] Created volume successfully. Apr 24 19:25:14 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f 1073741824" returned: 0 in 0.698s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:14 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f Apr 24 19:25:14 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:14 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f" returned: 0 in 0.541s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.897s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1812103247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1c8205-f7b0-4194-9ca3-774895d51da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d36190d4514595800365ba25369512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:09Z,use_quota=True,user_id='1d8fe3eed0cf42fc8daecfd0353c051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Creating volume 6d1c8205-f7b0-4194-9ca3-774895d51da5 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:14 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:14 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5 1073741824 Apr 24 19:25:14 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ecdee8-2d10-46c3-befe-e21c3c080e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a951f3a-f871-42e3-bd63-a0cf62934774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:14 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Volume volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f (d946f148-b8ee-4d2a-821f-e7cdc5dc031f): created successfully Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a951f3a-f871-42e3-bd63-a0cf62934774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:14 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Flow 'volume_create_manager' (212d6959-92b7-4719-8a2c-cc2bfcb939fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:14 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-85adec85-c398-42da-8986-2c44916e45fd tempest-CreateVolumesFromImageTest-1505476382 None] Created volume successfully. Apr 24 19:25:15 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5 1073741824" returned: 0 in 0.772s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:15 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:15 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5 Apr 24 19:25:15 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:15 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5" returned: 0 in 0.530s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.846s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2118869839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438cb6ba-cfc7-4388-8feb-9e240375a8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d36190d4514595800365ba25369512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:09Z,use_quota=True,user_id='1d8fe3eed0cf42fc8daecfd0353c051d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Creating volume 438cb6ba-cfc7-4388-8feb-9e240375a8ed {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:16 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48280977-7dac-48aa-be7b-2406cf84bea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1c8205-f7b0-4194-9ca3-774895d51da5', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35379df-6263-4fc2-8c0f-83bca55f8140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:16 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed 1073741824 Apr 24 19:25:16 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:16 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Volume volume-6d1c8205-f7b0-4194-9ca3-774895d51da5 (6d1c8205-f7b0-4194-9ca3-774895d51da5): created successfully Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35379df-6263-4fc2-8c0f-83bca55f8140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Flow 'volume_create_manager' (0721425e-433a-4911-874b-529cb0dfeadf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:16 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c921c172-3b52-404b-82cb-96ecef0528b8 tempest-CreateVolumesFromImageTest-1505476382 None] Created volume successfully. Apr 24 19:25:16 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed 1073741824" returned: 0 in 0.629s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:16 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed Apr 24 19:25:16 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:17 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed" returned: 0 in 0.508s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.433s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1653773124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2a9c9a-a466-4165-8864-3f30e494bcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:10Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Creating volume fc2a9c9a-a466-4165-8864-3f30e494bcf3 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:17 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f51697-92fa-4d98-8fe8-6bc53ea53ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4aab80-93ce-4316-80c9-bedf4484f5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:17 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3 1073741824 Apr 24 19:25:17 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:17 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Volume volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed (438cb6ba-cfc7-4388-8feb-9e240375a8ed): created successfully Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4aab80-93ce-4316-80c9-bedf4484f5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Flow 'volume_create_manager' (ec9b4b9e-e8ea-4d22-95df-fda777b9b183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:17 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-7b1874f7-c041-4fd9-baf4-902b52d50c9d tempest-CreateVolumesFromImageTest-1505476382 None] Created volume successfully. Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "cinder-438cb6ba-cfc7-4388-8feb-9e240375a8ed-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-438cb6ba-cfc7-4388-8feb-9e240375a8ed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "cinder-quobyte-438cb6ba-cfc7-4388-8feb-9e240375a8ed" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-quobyte-438cb6ba-cfc7-4388-8feb-9e240375a8ed" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e6d6cd-1336-4ae2-a90d-b66338ca061b]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:18 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3 1073741824" returned: 0 in 0.925s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:18 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed Apr 24 19:25:18 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:18 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3 Apr 24 19:25:18 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:18 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3" returned: 0 in 0.537s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:18 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.568s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-954543788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b86ae4f-03f5-49b4-8eb9-40f04575cf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:10Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Creating volume 6b86ae4f-03f5-49b4-8eb9-40f04575cf4c {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:18 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed" returned: 0 in 0.650s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:18 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c 1073741824 Apr 24 19:25:18 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9a081b-2cc5-4c98-b48e-4ad88558af61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5c08d2-2edf-4566-9409-ed1ea18b4202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:18 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed Apr 24 19:25:18 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:18 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3 (fc2a9c9a-a466-4165-8864-3f30e494bcf3): created successfully Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5c08d2-2edf-4566-9409-ed1ea18b4202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:18 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (0ea9b33d-4e65-4672-b7aa-2fc0d3d5c46b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:18 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-120fca02-a887-49a3-9816-ed9a57926b0f tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created volume successfully. Apr 24 19:25:19 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-438cb6ba-cfc7-4388-8feb-9e240375a8ed" returned: 0 in 0.526s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-quobyte-438cb6ba-cfc7-4388-8feb-9e240375a8ed" released by "delete_volume" :: held 1.219s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Created reservations ['657595c4-9c65-4957-b325-0b8396526adf', '62c7ddff-8a33-4a78-8f7d-26e537bbc027', 'eb34e616-43de-4672-9e95-feff13956bb2', '6a89d71c-9036-4d5d-a686-26b1c1947e79'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:19 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:19 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:19 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c 1073741824" returned: 0 in 0.738s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:19 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c Apr 24 19:25:19 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:19 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.489s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:19 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Deleted volume successfully. Apr 24 19:25:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e25af2d4-e127-45c8-afa8-9fa68f1a221f tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-438cb6ba-cfc7-4388-8feb-9e240375a8ed-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:20 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c" returned: 0 in 0.548s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.513s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-126836313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80446c52-0a25-48fa-8dd9-9febfd24ae54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:10Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Creating volume 80446c52-0a25-48fa-8dd9-9febfd24ae54 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:20 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f21263c-fa17-4245-8c19-b5ba8eebd941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db23ed1a-5daf-412c-8aad-30508c8fbbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:20 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54 1073741824 Apr 24 19:25:20 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:20 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c (6b86ae4f-03f5-49b4-8eb9-40f04575cf4c): created successfully Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db23ed1a-5daf-412c-8aad-30508c8fbbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (76239aec-7748-4a68-a8f5-474ec49d7b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:20 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9207e8d6-78f1-410e-a8ae-e4efe004f8d5 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created volume successfully. Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "cinder-6d1c8205-f7b0-4194-9ca3-774895d51da5-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-6d1c8205-f7b0-4194-9ca3-774895d51da5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "cinder-quobyte-6d1c8205-f7b0-4194-9ca3-774895d51da5" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-quobyte-6d1c8205-f7b0-4194-9ca3-774895d51da5" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2faf852-3e5a-4cac-8112-7f2783aafd7f]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:20 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5 Apr 24 19:25:20 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:20 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54 1073741824" returned: 0 in 0.836s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:20 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54 Apr 24 19:25:20 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:21 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5" returned: 0 in 0.670s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:21 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5 Apr 24 19:25:21 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:21 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54" returned: 0 in 0.538s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.572s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1149157122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a0d789-74a4-4217-989a-415c79527cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:11Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Creating volume 16a0d789-74a4-4217-989a-415c79527cc8 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:21 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c27edf1-3978-45e9-8999-2142892b8350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80446c52-0a25-48fa-8dd9-9febfd24ae54', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:21 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8 1073741824 Apr 24 19:25:21 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c60882-ee3c-42a3-b1a5-c63f95cef7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:21 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume volume-80446c52-0a25-48fa-8dd9-9febfd24ae54 (80446c52-0a25-48fa-8dd9-9febfd24ae54): created successfully Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c60882-ee3c-42a3-b1a5-c63f95cef7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (4378908e-95d6-49d9-a58c-14076a83d7c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:21 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6d1c8205-f7b0-4194-9ca3-774895d51da5" returned: 0 in 0.509s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:21 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d092b994-66b9-417c-9019-7a0438fa3432 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created volume successfully. Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-quobyte-6d1c8205-f7b0-4194-9ca3-774895d51da5" released by "delete_volume" :: held 1.245s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Created reservations ['2d281c52-3cde-4c04-aca9-f7733d3a6b1b', '71eb3ad5-2424-4475-bbf1-d33298b84072', 'bb29d4f9-4e1f-4e1a-a60a-39beb0171196', '3b01eace-cfcf-486a-a71a-08100a3ddfae'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:21 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:21 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:22 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.566s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:22 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Deleted volume successfully. Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-b149783d-ea18-4840-8be0-9e72e3ac0951 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-6d1c8205-f7b0-4194-9ca3-774895d51da5-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:22 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8 1073741824" returned: 0 in 0.922s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:22 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8 Apr 24 19:25:22 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "cinder-d946f148-b8ee-4d2a-821f-e7cdc5dc031f-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-d946f148-b8ee-4d2a-821f-e7cdc5dc031f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "cinder-quobyte-d946f148-b8ee-4d2a-821f-e7cdc5dc031f" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-quobyte-d946f148-b8ee-4d2a-821f-e7cdc5dc031f" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5f5649-695c-4d77-8cd1-ff09ece45434]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:22 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f Apr 24 19:25:22 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:22 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8" returned: 0 in 0.523s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.772s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-335205573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86fc6d40-ef0e-44be-9764-c493a665511b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d4eff5d8a249538b6a237ffe74719d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:11Z,use_quota=True,user_id='4c9356500e7043ccadf3cb1cd57dfaa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Creating volume 86fc6d40-ef0e-44be-9764-c493a665511b {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:22 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:22 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75185850-6e01-455d-9171-6beb5ce66a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a0d789-74a4-4217-989a-415c79527cc8', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b385f22c-c32d-4e9b-b5aa-58803fd7ebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:23 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b 1073741824 Apr 24 19:25:23 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:23 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume volume-16a0d789-74a4-4217-989a-415c79527cc8 (16a0d789-74a4-4217-989a-415c79527cc8): created successfully Apr 24 19:25:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b385f22c-c32d-4e9b-b5aa-58803fd7ebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:23 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (072f134e-1f4d-48fe-a5c2-abbc3a1e4ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:23 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-10d307ba-0963-4326-a035-3031f203e319 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created volume successfully. Apr 24 19:25:23 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f" returned: 0 in 0.777s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:23 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f Apr 24 19:25:23 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:23 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b 1073741824" returned: 0 in 0.867s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:23 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b Apr 24 19:25:23 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:24 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d946f148-b8ee-4d2a-821f-e7cdc5dc031f" returned: 0 in 0.685s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-quobyte-d946f148-b8ee-4d2a-821f-e7cdc5dc031f" released by "delete_volume" :: held 1.515s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Created reservations ['4389cf89-ef54-4e51-9c24-afe8ca6f84b2', '961048e1-29e5-4a71-bae2-de3f9ab9521b', '351db4b0-c97a-41be-b37d-b42a57803d5e', '334efd39-c3ff-4dac-b019-600daaa87405'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:24 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:24 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:24 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b" returned: 0 in 0.599s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.599s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] Creating offline snapshot 2f408c75-c53c-4d29-9543-0ae4ed49ecdc of volume 3e6a9fe1-e25d-477f-96f5-d6fed256ca6e {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6966a61d-5e80-4c6a-808a-17833033aa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86fc6d40-ef0e-44be-9764-c493a665511b', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83099239-2a2b-4dc7-8145-e684d6909644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fcae19-5809-4a7d-a0db-447f788f6a0c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:24 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Volume volume-86fc6d40-ef0e-44be-9764-c493a665511b (86fc6d40-ef0e-44be-9764-c493a665511b): created successfully Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83099239-2a2b-4dc7-8145-e684d6909644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Flow 'volume_create_manager' (c5cb0ef1-5951-4660-be15-851dfa463722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:24 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-5d37de78-edce-49a8-bbae-c9e2fceded34 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created volume successfully. Apr 24 19:25:24 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e Apr 24 19:25:24 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "cinder-64bc846d-d47e-443e-b7e4-bdb9ad87c0de-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-64bc846d-d47e-443e-b7e4-bdb9ad87c0de-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "cinder-quobyte-64bc846d-d47e-443e-b7e4-bdb9ad87c0de" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-quobyte-64bc846d-d47e-443e-b7e4-bdb9ad87c0de" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:24 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.628s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:24 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Deleted volume successfully. Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[499c482f-0bcb-445e-a703-c2df8e646eb6]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-39b4c375-f22d-4223-8522-97e1e3bd8d04 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-d946f148-b8ee-4d2a-821f-e7cdc5dc031f-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:25 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de Apr 24 19:25:25 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:25 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" returned: 0 in 0.819s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:25 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc 1G Apr 24 19:25:25 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-86fc6d40-ef0e-44be-9764-c493a665511b-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-86fc6d40-ef0e-44be-9764-c493a665511b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-quobyte-86fc6d40-ef0e-44be-9764-c493a665511b" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-86fc6d40-ef0e-44be-9764-c493a665511b" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:25 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e756e4f-89ee-4b2e-9d47-47440d2ba507]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:25 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b Apr 24 19:25:25 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:25 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de" returned: 0 in 0.965s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:25 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de Apr 24 19:25:25 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:26 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc 1G" returned: 0 in 1.207s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:26 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc Apr 24 19:25:26 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:26 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b" returned: 0 in 1.021s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:26 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-64bc846d-d47e-443e-b7e4-bdb9ad87c0de" returned: 0 in 0.799s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:26 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b Apr 24 19:25:26 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-quobyte-64bc846d-d47e-443e-b7e4-bdb9ad87c0de" released by "delete_volume" :: held 1.832s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:26 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Created reservations ['6ad47ac2-5d6c-4154-ab01-0e7c731afa1b', '714ffe91-e4a6-46ff-81af-d89eaa25ec11', 'd0cdf4f5-60cc-4198-9124-e8e059e74154', 'bfbbb9e9-8b8c-4b50-a8b1-5281ecd60da9'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:27 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:27 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "cinder-a3e4186f-3d02-4919-972e-e1bc59dd9ac4-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-a3e4186f-3d02-4919-972e-e1bc59dd9ac4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "cinder-quobyte-a3e4186f-3d02-4919-972e-e1bc59dd9ac4" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-quobyte-a3e4186f-3d02-4919-972e-e1bc59dd9ac4" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c767a85-a6c5-422f-85f3-886bd5f930af]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:27 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4 Apr 24 19:25:27 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:27 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-86fc6d40-ef0e-44be-9764-c493a665511b" returned: 0 in 0.893s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-86fc6d40-ef0e-44be-9764-c493a665511b" released by "delete_volume" :: held 1.974s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:27 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.903s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:27 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Deleted volume successfully. Apr 24 19:25:27 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc" returned: 0 in 1.335s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:27 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc is being set with open permissions: ugo+rw Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:27 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc Apr 24 19:25:27 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:27 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created reservations ['7c4ab080-6344-440a-b598-94313eb57627', '36029562-c71e-4a1c-820d-2a973281f6bf', '60bb24d3-acb8-449f-8e6f-ae8eaf3dbf1b', 'bda6bf1c-8e05-41f5-be82-e7a2ca5a6fba'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-4aee9f09-114d-4f96-9026-41889a4ccb30 tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-64bc846d-d47e-443e-b7e4-bdb9ad87c0de-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:28 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4" returned: 0 in 0.839s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:28 devstack sudo[91257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4 Apr 24 19:25:28 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:28 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:28 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:28 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc" returned: 0 in 0.623s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:28 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.info Apr 24 19:25:28 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:28 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.552s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Deleted volume successfully. Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-43c79cb2-52e1-4afd-908f-ab3513214725 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-86fc6d40-ef0e-44be-9764-c493a665511b-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:28 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-a3e4186f-3d02-4919-972e-e1bc59dd9ac4" returned: 0 in 0.684s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-quobyte-a3e4186f-3d02-4919-972e-e1bc59dd9ac4" released by "delete_volume" :: held 1.608s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-16a0d789-74a4-4217-989a-415c79527cc8-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Created reservations ['6345cedf-85ec-4c13-bd74-8a3cec93d33a', 'e68123d3-81cc-43b1-a3a6-8b8eb03c7299', '13357550-c600-44ee-8487-7cc1d98ee477', '7d8e6757-c24b-47a6-b81f-0480d3ffd372'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-16a0d789-74a4-4217-989a-415c79527cc8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-quobyte-16a0d789-74a4-4217-989a-415c79527cc8" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-16a0d789-74a4-4217-989a-415c79527cc8" acquired by "delete_volume" :: waited 0.052s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:29 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:29 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f994f7cf-dc36-4749-82b6-544d520d4360]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:29 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.info" returned: 0 in 0.637s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:29 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.info is being set with open permissions: ugo+rw Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:29 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.info Apr 24 19:25:29 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:29 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8 Apr 24 19:25:29 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:29 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.853s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:29 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:30 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Deleted volume successfully. Apr 24 19:25:30 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.info" returned: 0 in 0.772s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.539s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:30 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0663fa30-fc88-421c-81cb-6cd7b6230efc tempest-CreateVolumesFromImageTest-1505476382 None] Lock "cinder-a3e4186f-3d02-4919-972e-e1bc59dd9ac4-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8" returned: 0 in 0.898s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:30 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-dc714392-c58f-4cd6-8a8c-9c981b457db4 tempest-VolumeDependencyTests-1446922614 None] Create snapshot completed successfully Apr 24 19:25:30 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8 Apr 24 19:25:30 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:30 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-16a0d789-74a4-4217-989a-415c79527cc8" returned: 0 in 0.584s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-16a0d789-74a4-4217-989a-415c79527cc8" released by "delete_volume" :: held 1.533s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created reservations ['92955171-5e44-4fa2-82d5-7c0f35e1f924', '3b2b34e2-a22b-432f-b038-27be731a8890', 'e19bbce8-dda4-4f01-a7ca-c695ba81601f', '0cb85205-0bec-4eb9-9301-43b3d6791280'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Flow 'volume_create_manager' (ad1d8407-e9e0-4817-9f9e-1959e2d17808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e686fbd9-5fe6-4237-b840-61ecaaaa4d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e686fbd9-5fe6-4237-b840-61ecaaaa4d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2042782468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2812c3-08ae-4351-b3f0-6c7b0e0cddce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a077bceeba4f4837813cfbc676c916cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:31Z,use_quota=True,user_id='dd076858fafd46bda30ba188a808346b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d95e032-dc0f-4950-a671-2416c920085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d95e032-dc0f-4950-a671-2416c920085a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559403b2-a83c-488a-bafb-4f7a47cda227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559403b2-a83c-488a-bafb-4f7a47cda227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2812c3-08ae-4351-b3f0-6c7b0e0cddce', 'volume_name': 'volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee34337-aef0-41c3-b31a-35716542c84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee34337-aef0-41c3-b31a-35716542c84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfadf49-088e-4149-bbec-c6a63f497cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:30 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Volume 5a2812c3-08ae-4351-b3f0-6c7b0e0cddce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce', 'volume_size': 1} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2042782468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2812c3-08ae-4351-b3f0-6c7b0e0cddce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a077bceeba4f4837813cfbc676c916cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:31Z,use_quota=True,user_id='dd076858fafd46bda30ba188a808346b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Creating volume 5a2812c3-08ae-4351-b3f0-6c7b0e0cddce {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:30 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:30 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce 1073741824 Apr 24 19:25:30 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:31 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:31 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-80446c52-0a25-48fa-8dd9-9febfd24ae54-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-80446c52-0a25-48fa-8dd9-9febfd24ae54-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Flow 'volume_create_manager' (b2b7613f-9b75-48c4-ab4e-01e4e35522a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da10efc2-7152-46ad-a60e-0a36b3bed946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da10efc2-7152-46ad-a60e-0a36b3bed946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-781028042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9500b24-493f-4ac8-8233-146db645491a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73acb25e690c436088f2891416b8afd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2f408c75-c53c-4d29-9543-0ae4ed49ecdc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:31Z,use_quota=True,user_id='d6ad4017216a4f64a378ed9d7bef46d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96845e48-e68c-4165-81fd-a858ff19e735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96845e48-e68c-4165-81fd-a858ff19e735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4758cb-2fb5-4e1c-8eba-ddca5ac68657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4758cb-2fb5-4e1c-8eba-ddca5ac68657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd9500b24-493f-4ac8-8233-146db645491a', 'volume_name': 'volume-d9500b24-493f-4ac8-8233-146db645491a', 'volume_size': 1, 'snapshot_id': '2f408c75-c53c-4d29-9543-0ae4ed49ecdc'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78a593f-b768-4f67-96db-99756155b4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78a593f-b768-4f67-96db-99756155b4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2799a1-6c8a-4320-b446-6774c22a2d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:31 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Volume d9500b24-493f-4ac8-8233-146db645491a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d9500b24-493f-4ac8-8233-146db645491a', 'volume_size': 1, 'snapshot_id': '2f408c75-c53c-4d29-9543-0ae4ed49ecdc'} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:31 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-quobyte-80446c52-0a25-48fa-8dd9-9febfd24ae54" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.519s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:31 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Deleted volume successfully. Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-80446c52-0a25-48fa-8dd9-9febfd24ae54" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-9d3bf032-fe7b-4edb-ab27-8937f69c3bd7 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-16a0d789-74a4-4217-989a-415c79527cc8-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa5180b-e858-4a78-9a06-663d0cb5363e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:31 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54 Apr 24 19:25:31 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:31 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce 1073741824" returned: 0 in 0.929s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:31 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce Apr 24 19:25:31 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:32 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54" returned: 0 in 0.662s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:32 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54 Apr 24 19:25:32 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:32 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" returned: 0 in 0.526s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.961s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-quobyte-2f408c75-c53c-4d29-9543-0ae4ed49ecdc-d9500b24-493f-4ac8-8233-146db645491a" by "_create_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfadf49-088e-4149-bbec-c6a63f497cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f38894-da06-4746-bc20-5b01f5ed7885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-2f408c75-c53c-4d29-9543-0ae4ed49ecdc-d9500b24-493f-4ac8-8233-146db645491a" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Creating volume d9500b24-493f-4ac8-8233-146db645491a from snapshot 2f408c75-c53c-4d29-9543-0ae4ed49ecdc {{(pid=82057) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-quobyte-d9500b24-493f-4ac8-8233-146db645491a" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:32 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Volume volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce (5a2812c3-08ae-4351-b3f0-6c7b0e0cddce): created successfully Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f38894-da06-4746-bc20-5b01f5ed7885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Flow 'volume_create_manager' (ad1d8407-e9e0-4817-9f9e-1959e2d17808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-d9500b24-493f-4ac8-8233-146db645491a" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] snapshot: 2f408c75-c53c-4d29-9543-0ae4ed49ecdc, volume: d9500b24-493f-4ac8-8233-146db645491a, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:25:32 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-dda8dec4-8e2d-4471-955c-6a3efd159037 tempest-SnapshotDependencyTests-408187837 None] Created volume successfully. Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1c5681-afdf-4f77-8ebf-d1182b8d1c85]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:32 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc Apr 24 19:25:32 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:32 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-80446c52-0a25-48fa-8dd9-9febfd24ae54" returned: 0 in 0.549s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-80446c52-0a25-48fa-8dd9-9febfd24ae54" released by "delete_volume" :: held 1.253s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created reservations ['5864a4e1-8131-4802-bc97-0af7e8d66627', 'c5f4479d-78ea-4ae7-b2a0-eeb2263ca5d4', '30d14e1f-0726-46c5-8ef2-e77dc0727e40', '51bb1a6f-273f-4c20-98a4-961dc7e939d5'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (d8bc12b1-6a89-4dba-838f-5888e7f67f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce06b30-4c65-4c9d-82d8-66d672a62771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:32 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce06b30-4c65-4c9d-82d8-66d672a62771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-413915382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdf713e-b81c-464e-9ea0-53044c345c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:33Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df70bf6d-3558-407b-9161-c60e655a9b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df70bf6d-3558-407b-9161-c60e655a9b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e833a4a5-39d4-43ef-8a41-b44b11681a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e833a4a5-39d4-43ef-8a41-b44b11681a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cdf713e-b81c-464e-9ea0-53044c345c90', 'volume_name': 'volume-2cdf713e-b81c-464e-9ea0-53044c345c90', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b465e6-2541-450b-80aa-7e084d0bb1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b465e6-2541-450b-80aa-7e084d0bb1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095011a0-79d4-4710-bfc4-c3fb65e36a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:33 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume 2cdf713e-b81c-464e-9ea0-53044c345c90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cdf713e-b81c-464e-9ea0-53044c345c90', 'volume_size': 1} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:33 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:33 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:33 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc" returned: 0 in 0.692s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[456bff2b-7cc8-4ae6-bb81-299210eea725]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:33 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e Apr 24 19:25:33 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:33 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.503s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:33 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Deleted volume successfully. Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-418fa118-d4b7-44e0-a6f1-3fc1dabd66dd tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-80446c52-0a25-48fa-8dd9-9febfd24ae54-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-quobyte-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c" acquired by "delete_volume" :: waited 0.018s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0de627-eb4d-4a70-9589-20669cb26b99]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:33 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c Apr 24 19:25:33 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:33 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" returned: 0 in 0.589s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:25:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:33 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a Apr 24 19:25:33 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:34 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c" returned: 0 in 0.525s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:34 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c Apr 24 19:25:34 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:34 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:34 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c" returned: 0 in 0.677s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:34 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c" released by "delete_volume" :: held 1.263s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:35 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created reservations ['c456dfcf-2b64-41d1-8d1e-69d62b26c403', '8253ca6a-f1eb-472e-821a-e3a12853d9b7', '87dd56c5-7431-4e7d-80ad-8779f48e2768', '1da14362-02f5-4c41-8388-a482a587410b'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:35 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:35 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:35 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:35 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:35 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:35 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-fc2a9c9a-a466-4165-8864-3f30e494bcf3-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:36 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-fc2a9c9a-a466-4165-8864-3f30e494bcf3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:36 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-quobyte-fc2a9c9a-a466-4165-8864-3f30e494bcf3" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:36 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-fc2a9c9a-a466-4165-8864-3f30e494bcf3" acquired by "delete_volume" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:36 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9902f2bc-e49f-4706-9b81-7f3479b00850]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:36 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3 Apr 24 19:25:36 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:36 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:36 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.555s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:36 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:36 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Deleted volume successfully. Apr 24 19:25:36 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-65beb247-8fb5-466e-b622-f3e8443499c3 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-6b86ae4f-03f5-49b4-8eb9-40f04575cf4c-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:37 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3" returned: 0 in 1.619s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:37 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:37 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3 Apr 24 19:25:37 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:38 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fc2a9c9a-a466-4165-8864-3f30e494bcf3" returned: 0 in 0.853s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:38 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-fc2a9c9a-a466-4165-8864-3f30e494bcf3" released by "delete_volume" :: held 2.559s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:38 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created reservations ['fca944ff-805c-4024-b769-ca9ad6b9da2c', 'b9c38dd2-b3b2-4961-ab7c-2e46f1dd4567', '62feef3b-21fb-4db9-8218-04e1491481bf', '78ad2a02-66a6-42b8-a679-8835b0c0ebf3'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:38 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:38 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:39 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:39 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:39 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a" returned: 0 in 5.213s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9732da9-7c9a-42a6-a8de-15aad0be66b8]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:39 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e Apr 24 19:25:39 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-414a04e8-5274-4fe9-825d-74f620f69cf4-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-414a04e8-5274-4fe9-825d-74f620f69cf4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "cinder-quobyte-414a04e8-5274-4fe9-825d-74f620f69cf4" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-414a04e8-5274-4fe9-825d-74f620f69cf4" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:39 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.571s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:39 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Deleted volume successfully. Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[547d9e90-09b6-4e4d-97ff-2ddff4f61d71]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d3210467-e500-4f0c-8e06-16fa287d8478 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-fc2a9c9a-a466-4165-8864-3f30e494bcf3-delete_volume" released by "delete_volume" :: held 3.562s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:39 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4 Apr 24 19:25:39 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:39 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" returned: 0 in 0.691s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:25:39 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Converted 1024.00 MB image at 196.39 MB/s Apr 24 19:25:39 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a is being set with open permissions: ugo+rw Apr 24 19:25:39 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:39 devstack sudo[91357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a Apr 24 19:25:39 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:40 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4" returned: 0 in 0.562s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:40 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4 Apr 24 19:25:40 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:40 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a" returned: 0 in 0.451s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-d9500b24-493f-4ac8-8233-146db645491a" released by "_copy_volume_from_snapshot" :: held 7.781s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-2f408c75-c53c-4d29-9543-0ae4ed49ecdc-d9500b24-493f-4ac8-8233-146db645491a" released by "_create_volume_from_snapshot" :: held 7.841s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.879s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.302s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-413915382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdf713e-b81c-464e-9ea0-53044c345c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:33Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Creating volume 2cdf713e-b81c-464e-9ea0-53044c345c90 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:40 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:40 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 1073741824 Apr 24 19:25:40 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2799a1-6c8a-4320-b446-6774c22a2d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9500b24-493f-4ac8-8233-146db645491a', 'volume_size': 1, 'snapshot_id': '2f408c75-c53c-4d29-9543-0ae4ed49ecdc'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1dc417-f8fc-4870-b621-ec0b27c64087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:40 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Volume volume-d9500b24-493f-4ac8-8233-146db645491a (d9500b24-493f-4ac8-8233-146db645491a): created successfully Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1dc417-f8fc-4870-b621-ec0b27c64087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Flow 'volume_create_manager' (b2b7613f-9b75-48c4-ab4e-01e4e35522a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:40 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-cca20bb8-a4c9-4ab2-8027-b77318a591ba tempest-VolumeDependencyTests-1446922614 None] Created volume successfully. Apr 24 19:25:40 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-414a04e8-5274-4fe9-825d-74f620f69cf4" returned: 0 in 0.514s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-quobyte-414a04e8-5274-4fe9-825d-74f620f69cf4" released by "delete_volume" :: held 1.131s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Created reservations ['b090c776-4fe9-4601-88c5-034e145c7809', 'a69facec-c431-42ec-b116-799f8b3315ec', '8b9b6222-428a-484f-8295-4c0b5bdee580', '403a67d5-ae34-49ba-a767-3f319879f6ff'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:40 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:40 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:40 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:41 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 1073741824" returned: 0 in 0.667s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:41 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 Apr 24 19:25:41 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-2f408c75-c53c-4d29-9543-0ae4ed49ecdc-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-2f408c75-c53c-4d29-9543-0ae4ed49ecdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-quobyte-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-quobyte-2f408c75-c53c-4d29-9543-0ae4ed49ecdc" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:41 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-2f408c75-c53c-4d29-9543-0ae4ed49ecdc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Deleting offline snapshot 2f408c75-c53c-4d29-9543-0ae4ed49ecdc of volume 3e6a9fe1-e25d-477f-96f5-d6fed256ca6e {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] snapshot_file for this snap is: volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.512s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:41 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Deleted volume successfully. Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f75083-1633-456a-81ec-b17be438fb86]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-57805d2b-21af-4177-96b9-83c451209149 tempest-CreateVolumesFromSourceVolumeTest-1255022797 None] Lock "cinder-414a04e8-5274-4fe9-825d-74f620f69cf4-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:41 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc Apr 24 19:25:41 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:41 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90" returned: 0 in 0.479s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.363s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095011a0-79d4-4710-bfc4-c3fb65e36a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cdf713e-b81c-464e-9ea0-53044c345c90', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67391ae1-af4d-405e-b2bc-1edf2454358d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] Creating offline snapshot 382ac49f-0238-416e-be9a-985d808c7843 of volume 5a2812c3-08ae-4351-b3f0-6c7b0e0cddce {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:25:41 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume volume-2cdf713e-b81c-464e-9ea0-53044c345c90 (2cdf713e-b81c-464e-9ea0-53044c345c90): created successfully Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67391ae1-af4d-405e-b2bc-1edf2454358d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (d8bc12b1-6a89-4dba-838f-5888e7f67f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7ae11c-f96e-4fa9-b111-1ed0a9db7931]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:41 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-48f19c9b-9ab5-4844-a748-c43e244da6ef tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created volume successfully. Apr 24 19:25:41 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce Apr 24 19:25:41 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:41 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc" returned: 0 in 0.683s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:41 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:42 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf543d6-65a0-4051-b900-257443114d78]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:42 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e Apr 24 19:25:42 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:42 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" returned: 0 in 0.659s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:42 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 1G Apr 24 19:25:42 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:42 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" returned: 0 in 0.682s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:42 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc Apr 24 19:25:42 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:42 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 1G" returned: 0 in 0.714s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:42 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:43 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 Apr 24 19:25:43 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:43 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc" returned: 0 in 0.691s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:43 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc Apr 24 19:25:43 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:43 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843" returned: 0 in 0.635s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:43 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 is being set with open permissions: ugo+rw Apr 24 19:25:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:43 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 Apr 24 19:25:43 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:43 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:43 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e.2f408c75-c53c-4d29-9543-0ae4ed49ecdc" returned: 0 in 0.549s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-2f408c75-c53c-4d29-9543-0ae4ed49ecdc" released by "_delete_snapshot" :: held 2.757s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:43 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" released by "delete_snapshot" :: held 2.784s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Created reservations ['fce43c2f-2eea-4813-b520-335ccede5dd2', '020ef0f0-03c4-431e-921e-426453db6450', 'b5140109-e2fe-4a0c-807b-8b9624b106bb', '4eae8c48-94b8-4502-8cdb-f72bf63bc036'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:44 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Delete snapshot completed successfully. Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-6764b4b0-9b43-4781-8996-a441f8ca1c3c tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-2f408c75-c53c-4d29-9543-0ae4ed49ecdc-delete_snapshot" released by "delete_snapshot" :: held 2.937s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:44 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843" returned: 0 in 0.587s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:44 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.info Apr 24 19:25:44 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-quobyte-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b54903a-de04-4433-979e-f2cf3a5cc105]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:44 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e Apr 24 19:25:44 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:44 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.info" returned: 0 in 0.535s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:44 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.info is being set with open permissions: ugo+rw Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:44 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.info Apr 24 19:25:44 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Flow 'volume_create_manager' (71bee52f-aa82-42e5-b98d-b0c801cf1c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3190b4-d4ab-45eb-80b8-a5b41172bc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3190b4-d4ab-45eb-80b8-a5b41172bc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12632909-b35f-483a-94fa-b9ee1971faa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a247a6c1e6749c7b339abf7d303d5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:45Z,use_quota=True,user_id='6fda5a3ff3e34e249ef5b1fa77060427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e29f828-4faa-4871-9eec-44fe440d0470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e29f828-4faa-4871-9eec-44fe440d0470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1d5ab9-b5bb-4ec9-96e0-7e5a8f39389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1d5ab9-b5bb-4ec9-96e0-7e5a8f39389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12632909-b35f-483a-94fa-b9ee1971faa7', 'volume_name': 'volume-12632909-b35f-483a-94fa-b9ee1971faa7', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e631de38-2279-4794-bab8-bff8be47f78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e631de38-2279-4794-bab8-bff8be47f78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4166192c-a44b-44ce-80ff-299baa41d394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:44 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Volume 12632909-b35f-483a-94fa-b9ee1971faa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12632909-b35f-483a-94fa-b9ee1971faa7', 'volume_size': 1} Apr 24 19:25:44 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:45 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" returned: 0 in 0.611s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:45 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e Apr 24 19:25:45 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:45 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.info" returned: 0 in 0.491s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.746s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.253s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:45 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0f5222cc-a2ca-4285-81ea-8d923d465948 tempest-SnapshotDependencyTests-408187837 None] Create snapshot completed successfully Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Creating offline snapshot 09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 of volume 2cdf713e-b81c-464e-9ea0-53044c345c90 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b6f9ba-335f-4d61-8030-12026377334f]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:45 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 Apr 24 19:25:45 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:45 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" returned: 0 in 0.451s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e" released by "delete_volume" :: held 1.137s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Created reservations ['16d7ea3d-4459-4752-8981-680d02730540', '1d2f18a3-03b9-4405-9f57-ec0212a2f9c2', '3525a190-5b11-4b6e-b7d9-655964872701', '5ccbcfb1-e0ad-447a-ac21-913312426bab'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:45 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:45 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:45 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90" returned: 0 in 0.562s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:45 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:45 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 1G Apr 24 19:25:45 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:46 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.534s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:46 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Deleted volume successfully. Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Flow 'volume_create_manager' (8a526582-ab49-4928-9c72-087681d38ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956673d6-a673-443d-9054-9d685db94ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=122,cinder:DELETE=17,cinder:INSERT=45,cinder:UPDATE=175 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956673d6-a673-443d-9054-9d685db94ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c5c1ac-1e7b-4188-be0b-ee2c95f71f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a077bceeba4f4837813cfbc676c916cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=382ac49f-0238-416e-be9a-985d808c7843,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:46Z,use_quota=True,user_id='dd076858fafd46bda30ba188a808346b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628b9004-b5fd-48c1-a565-6ce10ff5990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628b9004-b5fd-48c1-a565-6ce10ff5990f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3634078-0961-4168-9c2b-dddcb746f450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3634078-0961-4168-9c2b-dddcb746f450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08c5c1ac-1e7b-4188-be0b-ee2c95f71f41', 'volume_name': 'volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41', 'volume_size': 1, 'snapshot_id': '382ac49f-0238-416e-be9a-985d808c7843'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cd7fff-3753-4402-bd9d-23d6652ef06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cd7fff-3753-4402-bd9d-23d6652ef06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da38e66-501c-4798-a8b8-91a1b8e660b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:46 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Volume 08c5c1ac-1e7b-4188-be0b-ee2c95f71f41: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41', 'volume_size': 1, 'snapshot_id': '382ac49f-0238-416e-be9a-985d808c7843'} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0aa3bcea-32da-421d-9b38-1b16b9694d8d tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-3e6a9fe1-e25d-477f-96f5-d6fed256ca6e-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:46 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 1G" returned: 0 in 0.790s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdf713e-b81c-464e-9ea0-53044c345c90 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:46 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdf713e-b81c-464e-9ea0-53044c345c90 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 Apr 24 19:25:46 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Flow 'volume_create_manager' (4acd026f-958c-4b56-8473-f73521fb342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12662f0-16e8-46b3-bc5d-1d2233aea204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:46 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12662f0-16e8-46b3-bc5d-1d2233aea204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-936940298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17dc4c3-a4e7-4c5c-871a-1cd8cc471838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73acb25e690c436088f2891416b8afd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:47Z,use_quota=True,user_id='d6ad4017216a4f64a378ed9d7bef46d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f2fbc9-3723-405b-a98a-563b45db6e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f2fbc9-3723-405b-a98a-563b45db6e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f9df50-a12b-432b-ae99-b239cea3c9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f9df50-a12b-432b-ae99-b239cea3c9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17dc4c3-a4e7-4c5c-871a-1cd8cc471838', 'volume_name': 'volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e236e9-f903-4eaf-bb08-e521be5aea8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e236e9-f903-4eaf-bb08-e521be5aea8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95beebb6-06e9-496d-9aa9-8a741ebb350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:47 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Volume d17dc4c3-a4e7-4c5c-871a-1cd8cc471838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838', 'volume_size': 1} Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:47 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cdf713e-b81c-464e-9ea0-53044c345c90 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6" returned: 0 in 0.559s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:47 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 is being set with open permissions: ugo+rw Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:47 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 Apr 24 19:25:47 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6" returned: 0 in 0.477s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:47 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:47 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:47 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.info Apr 24 19:25:47 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:48 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.info" returned: 0 in 0.494s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:48 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.info is being set with open permissions: ugo+rw Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:48 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.info Apr 24 19:25:48 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:48 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.info" returned: 0 in 0.474s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.471s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.906s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12632909-b35f-483a-94fa-b9ee1971faa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a247a6c1e6749c7b339abf7d303d5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:45Z,use_quota=True,user_id='6fda5a3ff3e34e249ef5b1fa77060427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Creating volume 12632909-b35f-483a-94fa-b9ee1971faa7 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:48 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:48 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:48 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7 1073741824 Apr 24 19:25:48 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:48 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-00111019-93de-42af-af56-8f9d3cf53c03 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Create snapshot completed successfully Apr 24 19:25:49 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7 1073741824" returned: 0 in 0.683s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:49 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7 Apr 24 19:25:49 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (ede9ceca-2620-4d7f-8236-aff09b9d38cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ecd4b2-bdf1-498f-a4ea-38f83fd544db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ecd4b2-bdf1-498f-a4ea-38f83fd544db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668851294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:50Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b8ac5c-43e5-4e77-ab89-327e049e30b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b8ac5c-43e5-4e77-ab89-327e049e30b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79412cb-87ce-470c-b35f-235d689b9143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79412cb-87ce-470c-b35f-235d689b9143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b', 'volume_name': 'volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c26f89c-7106-46a4-90de-325af947ccc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c26f89c-7106-46a4-90de-325af947ccc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a0b72a-99a3-42d7-913a-36458edd2e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:49 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume 10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b', 'volume_size': 1} Apr 24 19:25:49 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:50 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (70879b4c-64b9-4d99-ba24-38b02d81fb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c624219-843b-4a17-9655-3d112588aede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7" returned: 0 in 0.553s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.641s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "cinder-quobyte-382ac49f-0238-416e-be9a-985d808c7843-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" by "_create_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c624219-843b-4a17-9655-3d112588aede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973258154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f70d6e-83b9-4f9c-b6d2-d272f563f9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:50Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fdc0f3-8010-4add-aebd-6069870f44b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fdc0f3-8010-4add-aebd-6069870f44b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1700f7ef-688f-49e3-97ac-03f7be610ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1700f7ef-688f-49e3-97ac-03f7be610ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f70d6e-83b9-4f9c-b6d2-d272f563f9d3', 'volume_name': 'volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69115e39-8bab-473a-b3b6-eaf91b1e4e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69115e39-8bab-473a-b3b6-eaf91b1e4e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ac85d6-6893-46a1-b2de-7e873b64020c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume 50f70d6e-83b9-4f9c-b6d2-d272f563f9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3', 'volume_size': 1} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4166192c-a44b-44ce-80ff-299baa41d394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12632909-b35f-483a-94fa-b9ee1971faa7', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76408ae1-8090-4bc3-9555-e195d5ccd4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-382ac49f-0238-416e-be9a-985d808c7843-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" acquired by "_create_volume_from_snapshot" :: waited 0.094s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Creating volume 08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 from snapshot 382ac49f-0238-416e-be9a-985d808c7843 {{(pid=82057) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "cinder-quobyte-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:50 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Volume volume-12632909-b35f-483a-94fa-b9ee1971faa7 (12632909-b35f-483a-94fa-b9ee1971faa7): created successfully Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76408ae1-8090-4bc3-9555-e195d5ccd4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Flow 'volume_create_manager' (71bee52f-aa82-42e5-b98d-b0c801cf1c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] snapshot: 382ac49f-0238-416e-be9a-985d808c7843, volume: 08c5c1ac-1e7b-4188-be0b-ee2c95f71f41, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:25:50 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-218c82a4-8d6e-4b97-9301-ee2921309b17 tempest-CinderUnicodeTest-1826867387 None] Created volume successfully. Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9a66c9-2f4a-487a-9976-51ff40beeba3]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (9a25e276-e664-4fc2-9ff1-ee4074f180ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472e7b40-12a0-42d7-a83d-99d80862c8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 Apr 24 19:25:50 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472e7b40-12a0-42d7-a83d-99d80862c8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-803952800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7d076b-4352-4915-8c52-9cf96ba1a96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:50Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593daa96-67b7-45d4-82c2-2c9b769ad302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593daa96-67b7-45d4-82c2-2c9b769ad302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e533830-4d89-4496-90e0-f60fac3956a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e533830-4d89-4496-90e0-f60fac3956a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7d076b-4352-4915-8c52-9cf96ba1a96f', 'volume_name': 'volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a667de-263a-475d-a8c6-d33423310f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a667de-263a-475d-a8c6-d33423310f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5867f693-9280-4704-babc-28a52eaf355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume ed7d076b-4352-4915-8c52-9cf96ba1a96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f', 'volume_size': 1} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (b7c2060c-b7f8-4846-a6ce-bbd2f71d1b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d1577f-ab73-4b52-9e58-a272d553fd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d1577f-ab73-4b52-9e58-a272d553fd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1406233998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d4be39-7b94-4b15-af97-3fc80069716a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:51Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2532a4b-47f7-4c8a-8331-460a717abcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2532a4b-47f7-4c8a-8331-460a717abcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25fdb2f-67a6-402d-b8ac-214e00470ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25fdb2f-67a6-402d-b8ac-214e00470ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d4be39-7b94-4b15-af97-3fc80069716a', 'volume_name': 'volume-33d4be39-7b94-4b15-af97-3fc80069716a', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e311b-3955-4ab2-a3db-b19dc7858273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e311b-3955-4ab2-a3db-b19dc7858273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fcb365-150e-4f8a-9f3a-cef6c0d1a75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:50 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume 33d4be39-7b94-4b15-af97-3fc80069716a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d4be39-7b94-4b15-af97-3fc80069716a', 'volume_size': 1} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Flow 'volume_create_manager' (1a8b52d9-7aea-44c2-9830-7fa3486b8b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:50 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e12911-bd4a-402e-bfd8-5e9adaec828c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e12911-bd4a-402e-bfd8-5e9adaec828c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-236871933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3333a9fd-ddc2-41ab-867b-9fec9dcea588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a247a6c1e6749c7b339abf7d303d5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:51Z,use_quota=True,user_id='6fda5a3ff3e34e249ef5b1fa77060427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cd2d11-c159-462b-abc2-d56cdc762cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9cd2d11-c159-462b-abc2-d56cdc762cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6f894c-24ac-44d4-8208-55a33319edd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6f894c-24ac-44d4-8208-55a33319edd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3333a9fd-ddc2-41ab-867b-9fec9dcea588', 'volume_name': 'volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5882d47-6dd9-4fab-9dd4-b7302852a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5882d47-6dd9-4fab-9dd4-b7302852a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f608e9-1bd4-426d-8423-125102a004e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Volume 3333a9fd-ddc2-41ab-867b-9fec9dcea588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588', 'volume_size': 1} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:25:51 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (ee970c4d-92bc-4768-8ca7-a3dbb8a80f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee41a18f-468f-42de-a604-0df518d830ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843" returned: 0 in 0.869s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee41a18f-468f-42de-a604-0df518d830ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-79671909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcdca61-2164-4000-8dcc-f4e56598d87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:51Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f712ab05-072e-4574-a6a9-9c3f828a7e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f712ab05-072e-4574-a6a9-9c3f828a7e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9344a3c3-2e59-42b9-9cdd-3502599d3739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9344a3c3-2e59-42b9-9cdd-3502599d3739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdcdca61-2164-4000-8dcc-f4e56598d87e', 'volume_name': 'volume-fdcdca61-2164-4000-8dcc-f4e56598d87e', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ee7792-ac93-4468-a76b-e1d90ed7db2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ee7792-ac93-4468-a76b-e1d90ed7db2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bc59e8-8124-48b2-bbcd-d2138229ebe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:51 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume fdcdca61-2164-4000-8dcc-f4e56598d87e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdcdca61-2164-4000-8dcc-f4e56598d87e', 'volume_size': 1} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf8e36f-270e-4bf3-abee-91096ec131f4]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:51 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce Apr 24 19:25:51 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:51 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" returned: 0 in 0.552s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:25:51 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:51 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 Apr 24 19:25:51 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:56 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" returned: 0 in 4.644s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:56 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa83985e-7d15-4d9c-91f6-482b70e74ff3]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:56 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:56 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce Apr 24 19:25:56 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:57 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" returned: 0 in 0.630s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce, size 1024.00 MB, duration 4.65 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:25:57 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Converted 1024.00 MB image at 220.45 MB/s Apr 24 19:25:57 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 is being set with open permissions: ugo+rw Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:57 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 Apr 24 19:25:57 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:57 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" returned: 0 in 0.446s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" released by "_copy_volume_from_snapshot" :: held 7.296s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-382ac49f-0238-416e-be9a-985d808c7843-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" released by "_create_volume_from_snapshot" :: held 7.351s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.446s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.488s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-936940298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17dc4c3-a4e7-4c5c-871a-1cd8cc471838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73acb25e690c436088f2891416b8afd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:47Z,use_quota=True,user_id='d6ad4017216a4f64a378ed9d7bef46d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Creating volume d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:57 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:57 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:57 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 1073741824 Apr 24 19:25:57 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:58 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 1073741824" returned: 0 in 0.648s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da38e66-501c-4798-a8b8-91a1b8e660b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41', 'volume_size': 1, 'snapshot_id': '382ac49f-0238-416e-be9a-985d808c7843'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b942460-13b0-44f9-9d6f-cbda34851352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:58 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Volume volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 (08c5c1ac-1e7b-4188-be0b-ee2c95f71f41): created successfully Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b942460-13b0-44f9-9d6f-cbda34851352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Flow 'volume_create_manager' (8a526582-ab49-4928-9c72-087681d38ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-5e3d1059-2ab5-43e2-af5a-d40d62efca52 tempest-SnapshotDependencyTests-408187837 None] Created volume successfully. Apr 24 19:25:58 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 Apr 24 19:25:58 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_service.periodic_task [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82057) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:58 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:25:58 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:58 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838" returned: 0 in 0.485s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.967s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668851294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:50Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Creating volume 10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:58 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:58 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b 1073741824 Apr 24 19:25:58 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95beebb6-06e9-496d-9aa9-8a741ebb350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057ac34b-80fe-4375-ac1d-a0997ae8898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:58 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Volume volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 (d17dc4c3-a4e7-4c5c-871a-1cd8cc471838): created successfully Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057ac34b-80fe-4375-ac1d-a0997ae8898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Flow 'volume_create_manager' (4acd026f-958c-4b56-8473-f73521fb342b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:58 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-461395ff-7bf7-46bb-a83d-e97623455315 tempest-VolumeDependencyTests-1446922614 None] Created volume successfully. Apr 24 19:25:58 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.520s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:58 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-fc9de2b6-9087-45d5-a869-4a7c497222a4 None None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:25:59 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b 1073741824" returned: 0 in 0.606s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:59 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b Apr 24 19:25:59 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "cinder-382ac49f-0238-416e-be9a-985d808c7843-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-382ac49f-0238-416e-be9a-985d808c7843-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "cinder-quobyte-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "cinder-quobyte-382ac49f-0238-416e-be9a-985d808c7843" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-382ac49f-0238-416e-be9a-985d808c7843" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Deleting offline snapshot 382ac49f-0238-416e-be9a-985d808c7843 of volume 5a2812c3-08ae-4351-b3f0-6c7b0e0cddce {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] snapshot_file for this snap is: volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32aa38f-1a57-465b-98f2-485e73312eb8]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:59 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 Apr 24 19:25:59 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:59 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b" returned: 0 in 0.506s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.753s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-973258154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f70d6e-83b9-4f9c-b6d2-d272f563f9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:50Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Creating volume 50f70d6e-83b9-4f9c-b6d2-d272f563f9d3 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:25:59 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:25:59 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3 1073741824 Apr 24 19:25:59 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a0b72a-99a3-42d7-913a-36458edd2e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadfa94a-953a-4a59-a0de-288dc01861e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:25:59 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b (10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b): created successfully Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadfa94a-953a-4a59-a0de-288dc01861e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:25:59 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (ede9ceca-2620-4d7f-8236-aff09b9d38cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:25:59 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-5e881571-f7d9-4f63-81f8-679d427505a9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created volume successfully. Apr 24 19:26:00 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843" returned: 0 in 0.572s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c741e8b7-da96-46c3-84b3-e92bb4601b52]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:00 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce Apr 24 19:26:00 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.flows.manager.create_volume [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Flow 'volume_create_manager' (715dcf5b-6c9e-4f87-9158-cae807c1ba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6d5477-1f39-4a20-8a53-8cfe916c0bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6d5477-1f39-4a20-8a53-8cfe916c0bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1967228514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de89f0b-548e-41ac-8bf6-6ec3bf2903db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73acb25e690c436088f2891416b8afd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d17dc4c3-a4e7-4c5c-871a-1cd8cc471838,status='creating',terminated_at=None,updated_at=2026-04-24T17:26:00Z,use_quota=True,user_id='d6ad4017216a4f64a378ed9d7bef46d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df99265e-61f5-4bbc-a5a6-4ea2646a2050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df99265e-61f5-4bbc-a5a6-4ea2646a2050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2235015d-524b-4965-9f0f-8c64c97b1dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2235015d-524b-4965-9f0f-8c64c97b1dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3de89f0b-548e-41ac-8bf6-6ec3bf2903db', 'volume_name': 'volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db', 'volume_size': 1, 'source_volid': 'd17dc4c3-a4e7-4c5c-871a-1cd8cc471838', 'source_volstatus': 'available'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80ddd48-0071-42bd-9f65-b8fc4643f3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80ddd48-0071-42bd-9f65-b8fc4643f3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79587bfb-b6f7-4cdd-8917-15deaa55bed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:00 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Volume 3de89f0b-548e-41ac-8bf6-6ec3bf2903db: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db', 'volume_size': 1, 'source_volid': 'd17dc4c3-a4e7-4c5c-871a-1cd8cc471838', 'source_volstatus': 'available'} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:00 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3 1073741824" returned: 0 in 0.690s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:00 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3 Apr 24 19:26:00 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:00 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" returned: 0 in 0.586s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:00 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:00 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 Apr 24 19:26:00 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:01 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3" returned: 0 in 0.472s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.635s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-803952800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7d076b-4352-4915-8c52-9cf96ba1a96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:50Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Creating volume ed7d076b-4352-4915-8c52-9cf96ba1a96f {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:01 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ac85d6-6893-46a1-b2de-7e873b64020c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8aff6c-daed-40fd-9be7-56a7a42a1778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:01 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f 1073741824 Apr 24 19:26:01 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:01 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3 (50f70d6e-83b9-4f9c-b6d2-d272f563f9d3): created successfully Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8aff6c-daed-40fd-9be7-56a7a42a1778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (70879b4c-64b9-4d99-ba24-38b02d81fb62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-58e2e174-ee9d-421c-a180-ed51a8b5e3c3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created volume successfully. Apr 24 19:26:01 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843" returned: 0 in 0.565s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:01 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843 Apr 24 19:26:01 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:01 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce.382ac49f-0238-416e-be9a-985d808c7843" returned: 0 in 0.470s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-382ac49f-0238-416e-be9a-985d808c7843" released by "_delete_snapshot" :: held 2.292s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" released by "delete_snapshot" :: held 2.317s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:01 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f 1073741824" returned: 0 in 0.677s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:01 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f Apr 24 19:26:01 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Created reservations ['7d520e7b-73cb-42c6-9740-93cce477092d', '579dcde3-0b8b-4588-bf45-bcd54619671b', '0c8d05f9-93de-4ec2-9a0d-4b2ab0658129', '151f2365-d96a-4623-8b4a-51ed50a89e87'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:01 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Delete snapshot completed successfully. Apr 24 19:26:01 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-12768dfa-b492-4785-9296-0144b9159431 tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-382ac49f-0238-416e-be9a-985d808c7843-delete_snapshot" released by "delete_snapshot" :: held 2.500s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:02 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f" returned: 0 in 0.507s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.425s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1406233998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d4be39-7b94-4b15-af97-3fc80069716a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:51Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Creating volume 33d4be39-7b94-4b15-af97-3fc80069716a {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:02 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5867f693-9280-4704-babc-28a52eaf355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ad0180-9ba4-439e-94d7-67292ed5241e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:02 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a 1073741824 Apr 24 19:26:02 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:02 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f (ed7d076b-4352-4915-8c52-9cf96ba1a96f): created successfully Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ad0180-9ba4-439e-94d7-67292ed5241e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (9a25e276-e664-4fc2-9ff1-ee4074f180ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:02 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-f2a7f9fc-4434-465a-9aa7-5864fa8e87cd tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created volume successfully. Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "cinder-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "cinder-quobyte-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" acquired by "delete_volume" :: waited 0.028s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae6a1e3-80f0-427e-82ee-3eec30866a35]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:02 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:02 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce Apr 24 19:26:02 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:03 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a 1073741824" returned: 0 in 0.739s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:03 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a Apr 24 19:26:03 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:03 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" returned: 0 in 0.636s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:03 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce Apr 24 19:26:03 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:03 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a" returned: 0 in 0.494s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.575s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-236871933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3333a9fd-ddc2-41ab-867b-9fec9dcea588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a247a6c1e6749c7b339abf7d303d5f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:51Z,use_quota=True,user_id='6fda5a3ff3e34e249ef5b1fa77060427',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Creating volume 3333a9fd-ddc2-41ab-867b-9fec9dcea588 {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:03 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fcb365-150e-4f8a-9f3a-cef6c0d1a75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d4be39-7b94-4b15-af97-3fc80069716a', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245790fa-4d15-429b-b483-94134610c57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:03 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 1073741824 Apr 24 19:26:03 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:03 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume volume-33d4be39-7b94-4b15-af97-3fc80069716a (33d4be39-7b94-4b15-af97-3fc80069716a): created successfully Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245790fa-4d15-429b-b483-94134610c57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (b7c2060c-b7f8-4846-a6ce-bbd2f71d1b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:03 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-6de11d13-337d-4b8b-8c9f-99fafae2c15f tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created volume successfully. Apr 24 19:26:03 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" returned: 0 in 0.537s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:03 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce" released by "delete_volume" :: held 1.262s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Created reservations ['e7104068-f706-4f3d-9f4d-856f485fdd06', 'cae8a42a-dcf1-495b-982c-3a23c0c239a1', '3f1bcc6e-0ddd-45be-8f7c-27151a99514a', '9402eeec-ad20-4bfd-a0ba-de9460b02264'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:04 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:04 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:04 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 1073741824" returned: 0 in 0.753s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:04 devstack sudo[91578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 Apr 24 19:26:04 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:04 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.520s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:04 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Deleted volume successfully. Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-eaff613e-5a4b-43c1-80b2-335d77008afd tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-5a2812c3-08ae-4351-b3f0-6c7b0e0cddce-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "cinder-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:04 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588" returned: 0 in 0.486s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.745s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T17:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-79671909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcdca61-2164-4000-8dcc-f4e56598d87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3709c5861cf401db0d39953d43e91f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T17:25:51Z,use_quota=True,user_id='62a0d082b8784864ac6411f7004423ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cb5d77-e9c0-47bb-b004-9aa2497c0618),volume_type_id=13cb5d77-e9c0-47bb-b004-9aa2497c0618)}" {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Creating volume fdcdca61-2164-4000-8dcc-f4e56598d87e {{(pid=82057) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Selected osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 as target Quobyte volume. {{(pid=82057) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 19:26:04 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] casted to osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596 Apr 24 19:26:04 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e 1073741824 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:04 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e 1073741824 Apr 24 19:26:04 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f608e9-1bd4-426d-8423-125102a004e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9a8c91-98ac-4a29-94c5-ea2c9ac9485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "cinder-quobyte-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:05 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Volume volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 (3333a9fd-ddc2-41ab-867b-9fec9dcea588): created successfully Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9a8c91-98ac-4a29-94c5-ea2c9ac9485e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Flow 'volume_create_manager' (1a8b52d9-7aea-44c2-9830-7fa3486b8b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:05 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-1f1c235c-bc57-4b40-972f-148bd435edb2 tempest-CinderUnicodeTest-1826867387 None] Created volume successfully. Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b698b68-c61c-4f1f-9a60-c109f80dbc03]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:05 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 Apr 24 19:26:05 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:05 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e 1073741824" returned: 0 in 0.669s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:05 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" returned: 0 in 0.587s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:05 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:05 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41 Apr 24 19:26:05 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:05 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e Apr 24 19:26:05 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:06 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e" returned: 0 in 0.473s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'} {{(pid=82057) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.759s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:06 devstack cinder-volume[82057]: INFO cinder.volume.drivers.remotefs [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Cloning volume d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 to volume 3de89f0b-548e-41ac-8bf6-6ec3bf2903db Apr 24 19:26:06 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bc59e8-8124-48b2-bbcd-d2138229ebe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdcdca61-2164-4000-8dcc-f4e56598d87e', 'volume_size': 1}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f7d87e-2fa3-41e1-a3df-4379b1686bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" returned: 0 in 0.538s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:06 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Volume volume-fdcdca61-2164-4000-8dcc-f4e56598d87e (fdcdca61-2164-4000-8dcc-f4e56598d87e): created successfully Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f7d87e-2fa3-41e1-a3df-4379b1686bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Flow 'volume_create_manager' (ee970c4d-92bc-4768-8ca7-a3dbb8a80f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-quobyte-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41" released by "delete_volume" :: held 1.213s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:06 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-fa2d9fd7-0efe-4898-94d3-44bf727ad2bb tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created volume successfully. Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Creating offline snapshot ea249f9f-ca9e-46b4-927a-9cd7625d7f27 of volume d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc51e87e-afcd-4ee9-8816-b2f23b66a29c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Created reservations ['d0c190a4-32a3-4f32-bd3b-bfd0103847f7', 'b35be31a-df82-4aac-9f11-442932765a96', 'a11f808e-5e05-436a-b919-b34db74176ac', 'a07c800d-0109-45ab-bbd4-5f567bed16be'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:06 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 Apr 24 19:26:06 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-fdcdca61-2164-4000-8dcc-f4e56598d87e-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:06 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:06 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-fdcdca61-2164-4000-8dcc-f4e56598d87e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-quobyte-fdcdca61-2164-4000-8dcc-f4e56598d87e" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-fdcdca61-2164-4000-8dcc-f4e56598d87e" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be43b81-42e9-49c8-8a48-93570c1f52fc]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:06 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:06 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e Apr 24 19:26:06 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:07 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.507s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:07 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Deleted volume successfully. Apr 24 19:26:07 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-35ce581d-d922-4457-b687-94ea9d8bfcab tempest-SnapshotDependencyTests-408187837 None] Lock "cinder-08c5c1ac-1e7b-4188-be0b-ee2c95f71f41-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838" returned: 0 in 0.717s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:07 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 1G Apr 24 19:26:07 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:07 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e" returned: 0 in 0.614s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:07 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e Apr 24 19:26:07 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:07 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 1G" returned: 0 in 0.835s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:07 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-fdcdca61-2164-4000-8dcc-f4e56598d87e" returned: 0 in 0.618s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-fdcdca61-2164-4000-8dcc-f4e56598d87e" released by "delete_volume" :: held 1.291s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:07 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 Apr 24 19:26:07 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:07 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created reservations ['20c2c5e8-fda3-4a8e-a99d-c758b774ce4d', '94fcd65d-8cb5-4a82-aa5c-131b4ba5464b', '8ec72c1d-2456-4bd4-a57d-70723a5675ed', '04d275b5-ad5d-468d-8169-d24202215694'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:08 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:08 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:08 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27" returned: 0 in 0.699s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:08 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 is being set with open permissions: ugo+rw Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:08 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 Apr 24 19:26:08 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:08 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.567s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:08 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Deleted volume successfully. Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-60a2fd94-0fc7-444f-8708-a4a44a14aace tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-fdcdca61-2164-4000-8dcc-f4e56598d87e-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-33d4be39-7b94-4b15-af97-3fc80069716a-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-33d4be39-7b94-4b15-af97-3fc80069716a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-quobyte-33d4be39-7b94-4b15-af97-3fc80069716a" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-33d4be39-7b94-4b15-af97-3fc80069716a" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fdc036-a8fa-4865-b2b8-c5c3743ec6ba]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:08 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:09 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a Apr 24 19:26:09 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:09 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27" returned: 0 in 0.595s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:09 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.info Apr 24 19:26:09 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:09 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a" returned: 0 in 0.588s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:09 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a Apr 24 19:26:09 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:09 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.info" returned: 0 in 0.517s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:09 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.info is being set with open permissions: ugo+rw Apr 24 19:26:09 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:09 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.info Apr 24 19:26:09 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:10 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-33d4be39-7b94-4b15-af97-3fc80069716a" returned: 0 in 0.495s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-33d4be39-7b94-4b15-af97-3fc80069716a" released by "delete_volume" :: held 1.131s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:SELECT=157,cinder:UPDATE=200,cinder:DELETE=17,cinder:INSERT=42 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created reservations ['7da346d5-c403-498c-8c6b-9c01c67d334e', '5caf47d2-1f8f-4ca2-b9d9-335d53e7ee7c', '83a4a027-a29c-47cb-9149-f26514070feb', '03a1965a-40ed-4bd1-98d9-222c3a544528'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:10 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:10 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:10 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.info" returned: 0 in 0.575s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-quobyte-3de89f0b-548e-41ac-8bf6-6ec3bf2903db" by "_copy_volume_from_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-3de89f0b-548e-41ac-8bf6-6ec3bf2903db" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] snapshot: ea249f9f-ca9e-46b4-927a-9cd7625d7f27, volume: 3de89f0b-548e-41ac-8bf6-6ec3bf2903db, {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b269107d-f623-48d2-881d-ecca9be05538]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:10 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 Apr 24 19:26:10 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:10 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.534s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:10 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Deleted volume successfully. Apr 24 19:26:10 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33a1a060-43d4-48d4-a40e-9e1e6c29ed8e tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-33d4be39-7b94-4b15-af97-3fc80069716a-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:11 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-ed7d076b-4352-4915-8c52-9cf96ba1a96f-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27" returned: 0 in 0.665s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] will copy from snapshot at /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Creating direct copy from snapshot {{(pid=82057) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-ed7d076b-4352-4915-8c52-9cf96ba1a96f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5abe4f-86d9-43c3-8f91-285da35b6768]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-quobyte-ed7d076b-4352-4915-8c52-9cf96ba1a96f" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-ed7d076b-4352-4915-8c52-9cf96ba1a96f" acquired by "delete_volume" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8a7d9-bc54-4017-bdb0-980fdb2c0c37]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:11 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 Apr 24 19:26:11 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:11 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f Apr 24 19:26:11 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:11 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838" returned: 0 in 0.607s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG cinder.utils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Path /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db not found in is_blk_device check {{(pid=82057) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:11 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db Apr 24 19:26:11 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:11 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f" returned: 0 in 0.596s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:11 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:11 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f Apr 24 19:26:11 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:12 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-ed7d076b-4352-4915-8c52-9cf96ba1a96f" returned: 0 in 0.460s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:12 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-ed7d076b-4352-4915-8c52-9cf96ba1a96f" released by "delete_volume" :: held 1.101s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:12 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created reservations ['f83b230b-c2c0-4877-b2ef-d35626a977cf', 'f03a2438-58c2-4683-a381-72b98c97c6dd', '93e666e1-6252-4bea-a5e2-1d863f9d794f', '56c255c7-a37b-4f7e-a63f-7ea568e8722e'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:12 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:12 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:12 devstack sudo[91676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:12 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-quobyte-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:13 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3" acquired by "delete_volume" :: waited 0.043s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:13 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7513a70-f2ee-4e57-af63-24fe0bd9ee49]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:13 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:14 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3 Apr 24 19:26:14 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:14 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.678s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:14 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:14 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Deleted volume successfully. Apr 24 19:26:14 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-0325491e-99f7-4aeb-8899-64f0b7e132ce tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-ed7d076b-4352-4915-8c52-9cf96ba1a96f-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:14 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3" returned: 0 in 1.277s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:14 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:14 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3 Apr 24 19:26:14 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:16 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3" returned: 0 in 1.633s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:16 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3" released by "delete_volume" :: held 3.059s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:16 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created reservations ['f9357f1b-3cfe-4d3f-a0a8-07fa7140bc13', 'af165259-2dec-4b67-9aa1-2f55d5328c0d', '12f001b4-0230-4d12-bb54-7e696358b38a', 'c24f4a24-6c93-463a-9221-b8c17e6f30fb'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:16 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:16 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:16 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:16 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-quobyte-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:17 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b" acquired by "delete_volume" :: waited 0.052s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:17 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81f2e48-b9c6-4858-8984-bb1c2dd51aea]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:17 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:17 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b Apr 24 19:26:17 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:18 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 1.175s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:18 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:18 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Deleted volume successfully. Apr 24 19:26:18 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-14b45ba2-7300-4f15-b82a-d187d9d7bee3 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-50f70d6e-83b9-4f9c-b6d2-d272f563f9d3-delete_volume" released by "delete_volume" :: held 4.656s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:18 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db" returned: 0 in 6.443s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:18 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff64fe7e-fb07-4402-91f8-8266733448e7]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:18 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 Apr 24 19:26:18 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:18 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b" returned: 0 in 1.033s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:18 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b Apr 24 19:26:18 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:18 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838" returned: 0 in 0.785s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:18 devstack cinder-volume[82057]: DEBUG cinder.image.image_utils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Image conversion details: src /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db {{(pid=82057) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 19:26:18 devstack cinder-volume[82057]: INFO cinder.image.image_utils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Converted 1024.00 MB image at 158.90 MB/s Apr 24 19:26:18 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db is being set with open permissions: ugo+rw Apr 24 19:26:18 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:19 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db Apr 24 19:26:19 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:19 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b" returned: 0 in 0.599s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b" released by "delete_volume" :: held 1.749s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created reservations ['000ef1e9-207a-4909-9067-a4006e7c91e1', '40504cbc-ba9c-4b3e-90a4-b3bff79cf9ef', 'f6c5edf3-ce2a-445a-8c83-8121b9eb1e0e', '84f45140-9d6b-4b41-9b73-33724ca0a135'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:19 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:19 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:19 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db" returned: 0 in 0.514s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-3de89f0b-548e-41ac-8bf6-6ec3bf2903db" released by "_copy_volume_from_snapshot" :: held 9.139s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-quobyte-ea249f9f-ca9e-46b4-927a-9cd7625d7f27" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-ea249f9f-ca9e-46b4-927a-9cd7625d7f27" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Deleting offline snapshot ea249f9f-ca9e-46b4-927a-9cd7625d7f27 of volume d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] snapshot_file for this snap is: volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[25133537-ad14-46a8-ab03-c7d51bdf8d94]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-09e7c875-245b-4d4e-b3d4-bc2a6f30acc6-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-09e7c875-245b-4d4e-b3d4-bc2a6f30acc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-quobyte-2cdf713e-b81c-464e-9ea0-53044c345c90" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-2cdf713e-b81c-464e-9ea0-53044c345c90" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-quobyte-09e7c875-245b-4d4e-b3d4-bc2a6f30acc6" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-09e7c875-245b-4d4e-b3d4-bc2a6f30acc6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Deleting offline snapshot 09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 of volume 2cdf713e-b81c-464e-9ea0-53044c345c90 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:26:19 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 Apr 24 19:26:19 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] snapshot_file for this snap is: volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[63338ce2-c466-485d-89d9-d8547c96d8b5]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:19 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 Apr 24 19:26:19 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:19 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.552s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:19 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Deleted volume successfully. Apr 24 19:26:19 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-73d9fd45-db29-4b5d-bc01-4edf9507a94a tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-10cf6ec9-8813-4ddf-a3e0-2eafc9ef438b-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:20 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27" returned: 0 in 0.574s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa0ec47-1f66-42b9-8670-c8663b1a35de]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:20 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 Apr 24 19:26:20 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:20 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6" returned: 0 in 0.588s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cdf713e-b81c-464e-9ea0-53044c345c90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f1fc8e-2cb5-4e08-9bf1-db6047ad71a8]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:20 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 Apr 24 19:26:20 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:20 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838" returned: 0 in 0.528s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:20 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 Apr 24 19:26:20 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:20 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90" returned: 0 in 0.510s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:20 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:20 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 Apr 24 19:26:20 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:21 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27" returned: 0 in 0.589s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:21 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27 Apr 24 19:26:21 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:21 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6" returned: 0 in 0.632s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:21 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6 Apr 24 19:26:21 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:21 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838.ea249f9f-ca9e-46b4-927a-9cd7625d7f27" returned: 0 in 0.476s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-ea249f9f-ca9e-46b4-927a-9cd7625d7f27" released by "_delete_snapshot" :: held 2.276s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.686s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.495s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] Creating offline snapshot 4e7ca865-62a9-4e78-97e5-3927833bf7ba of volume 3333a9fd-ddc2-41ab-867b-9fec9dcea588 {{(pid=82057) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79587bfb-b6f7-4cdd-8917-15deaa55bed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db', 'volume_size': 1, 'source_volid': 'd17dc4c3-a4e7-4c5c-871a-1cd8cc471838', 'source_volstatus': 'available'}' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe7bb28-6d1e-4f67-89b7-c9628b2ef93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[84020210-3190-4ae4-ba46-2d4ed105acf9]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:21 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:21 devstack cinder-volume[82057]: INFO cinder.volume.flows.manager.create_volume [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Volume volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db (3de89f0b-548e-41ac-8bf6-6ec3bf2903db): created successfully Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe7bb28-6d1e-4f67-89b7-c9628b2ef93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82057) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Flow 'volume_create_manager' (715dcf5b-6c9e-4f87-9158-cae807c1ba03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82057) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90.09e7c875-245b-4d4e-b3d4-bc2a6f30acc6" returned: 0 in 0.480s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:21 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-33789071-e6da-418e-9ace-6df6e0e7f234 tempest-VolumeDependencyTests-1446922614 None] Created volume successfully. Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-09e7c875-245b-4d4e-b3d4-bc2a6f30acc6" released by "_delete_snapshot" :: held 2.311s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:21 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-2cdf713e-b81c-464e-9ea0-53044c345c90" released by "delete_snapshot" :: held 2.343s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:21 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 Apr 24 19:26:21 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created reservations ['c9742d53-53a1-4875-8894-aa521f32c25c', '103ec49e-70b9-4f6c-9a5a-35baefe30570', '4102c931-f066-42ea-94af-589e982197fa', '0f40c5c5-9ad0-41a7-b8aa-0b96c57187c7'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:22 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Delete snapshot completed successfully. Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-01c2f7cc-8ffd-4d04-b244-6c7c9e1b90d9 tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-09e7c875-245b-4d4e-b3d4-bc2a6f30acc6-delete_snapshot" released by "delete_snapshot" :: held 2.492s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-quobyte-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838" acquired by "delete_volume" :: waited 0.015s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f7fbb3-347b-4728-b400-720270c9c9d5]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:22 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 Apr 24 19:26:22 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:22 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588" returned: 0 in 0.599s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba 1G {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:22 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba 1G Apr 24 19:26:22 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-2cdf713e-b81c-464e-9ea0-53044c345c90-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-2cdf713e-b81c-464e-9ea0-53044c345c90-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "cinder-quobyte-2cdf713e-b81c-464e-9ea0-53044c345c90" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-2cdf713e-b81c-464e-9ea0-53044c345c90" acquired by "delete_volume" :: waited 0.014s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2bef74-e08a-405e-87e8-a296bf2e0c1e]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:22 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838" returned: 0 in 0.633s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:22 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:23 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838 Apr 24 19:26:23 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:23 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 Apr 24 19:26:23 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:23 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba 1G" returned: 0 in 0.617s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:23 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba Apr 24 19:26:23 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:23 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838" returned: 0 in 0.497s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838" released by "delete_volume" :: held 1.203s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:23 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90" returned: 0 in 0.632s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Created reservations ['34d4df8c-2c9d-4dde-9801-afc89156452b', 'c5300367-980e-471e-8714-389ad0f0c83d', '4451dc1d-a082-4356-9daa-12a1ee677479', '2f23c7b1-b0f2-4513-92b9-3fb755316d2a'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:23 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90 Apr 24 19:26:23 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:23 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:23 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:23 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 -F qcow2 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba" returned: 0 in 0.595s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:23 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba is being set with open permissions: ugo+rw Apr 24 19:26:23 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:23 devstack sudo[91821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba Apr 24 19:26:23 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:24 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-2cdf713e-b81c-464e-9ea0-53044c345c90" returned: 0 in 0.494s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-quobyte-2cdf713e-b81c-464e-9ea0-53044c345c90" released by "delete_volume" :: held 1.189s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Created reservations ['956031f9-17d6-4685-8cc2-324164b3d2d0', 'e87d549b-382f-402b-b925-1f4cfc4f6181', 'd947c930-18b0-484f-86a3-2914a0039994', '1e733514-c2a8-4f7d-9d36-6147ac9022bc'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:24 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.500s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:24 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Deleted volume successfully. Apr 24 19:26:24 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba" returned: 0 in 0.508s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-ec3e7607-a7d9-4157-9779-e32120845366 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-d17dc4c3-a4e7-4c5c-871a-1cd8cc471838-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:24 devstack sudo[91826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:24 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:24 devstack sudo[91828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.info Apr 24 19:26:24 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-3de89f0b-548e-41ac-8bf6-6ec3bf2903db-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-3de89f0b-548e-41ac-8bf6-6ec3bf2903db-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-quobyte-3de89f0b-548e-41ac-8bf6-6ec3bf2903db" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-3de89f0b-548e-41ac-8bf6-6ec3bf2903db" acquired by "delete_volume" :: waited 0.027s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa1445c-663f-44bd-b05e-7da6f49d723c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:24 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db Apr 24 19:26:24 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:24 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.528s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:24 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Deleted volume successfully. Apr 24 19:26:24 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.info" returned: 0 in 0.531s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:24 devstack cinder-volume[82057]: WARNING cinder.volume.drivers.remotefs [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.info is being set with open permissions: ugo+rw Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.info {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:24 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-175c7697-4fd7-4507-8957-a3e5801dc28c tempest-CreateVolumesFromSnapshotTest-1424573550 None] Lock "cinder-2cdf713e-b81c-464e-9ea0-53044c345c90-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:24 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.info Apr 24 19:26:24 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:25 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db" returned: 0 in 0.610s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:25 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db Apr 24 19:26:25 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:25 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.info" returned: 0 in 0.521s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.505s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:25 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-57ed86fb-22fc-4a25-860d-2e2a3de5a183 tempest-CinderUnicodeTest-1826867387 None] Create snapshot completed successfully Apr 24 19:26:25 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3de89f0b-548e-41ac-8bf6-6ec3bf2903db" returned: 0 in 0.580s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-3de89f0b-548e-41ac-8bf6-6ec3bf2903db" released by "delete_volume" :: held 1.229s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Created reservations ['d861fc62-da5d-4357-9f8b-2acef578e1ec', '56f2f451-302e-4849-b827-a5dad1f31939', '4a44dace-3284-4495-b90c-ffbac231ee63', '011f5778-16bd-42e4-81f7-d402000282d7'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:25 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:25 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:25 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "cinder-4e7ca865-62a9-4e78-97e5-3927833bf7ba-delete_snapshot" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-4e7ca865-62a9-4e78-97e5-3927833bf7ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "cinder-quobyte-3333a9fd-ddc2-41ab-867b-9fec9dcea588" by "delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-quobyte-3333a9fd-ddc2-41ab-867b-9fec9dcea588" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "cinder-quobyte-4e7ca865-62a9-4e78-97e5-3927833bf7ba" by "_delete_snapshot" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-quobyte-4e7ca865-62a9-4e78-97e5-3927833bf7ba" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Deleting offline snapshot 4e7ca865-62a9-4e78-97e5-3927833bf7ba of volume 3333a9fd-ddc2-41ab-867b-9fec9dcea588 {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] snapshot_file for this snap is: volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba {{(pid=82057) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 19:26:26 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.537s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f45955-d910-4f3f-97f7-48ad38ffe35c]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:26 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Deleted volume successfully. Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-d4e5a19c-f094-47a4-85ac-1b141ca7340e tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-3de89f0b-548e-41ac-8bf6-6ec3bf2903db-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:26 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba Apr 24 19:26:26 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-d9500b24-493f-4ac8-8233-146db645491a-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-d9500b24-493f-4ac8-8233-146db645491a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "cinder-quobyte-d9500b24-493f-4ac8-8233-146db645491a" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-d9500b24-493f-4ac8-8233-146db645491a" acquired by "delete_volume" :: waited 0.017s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6386204-698e-4fae-9204-80915ea6f17d]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:26 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:26 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a Apr 24 19:26:26 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:27 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba" returned: 0 in 0.628s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.remotefs [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82057) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[08037646-32f9-4713-a8f0-ed3bda19498f]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:27 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 Apr 24 19:26:27 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:27 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a" returned: 0 in 0.527s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:27 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a Apr 24 19:26:27 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:27 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588" returned: 0 in 0.571s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:27 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba Apr 24 19:26:27 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:27 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-d9500b24-493f-4ac8-8233-146db645491a" returned: 0 in 0.460s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-quobyte-d9500b24-493f-4ac8-8233-146db645491a" released by "delete_volume" :: held 1.050s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Created reservations ['16b5fce4-ea09-43f0-9d58-5049cf517e74', '86104974-ef52-4960-8fa3-9526e653b9ee', 'ffdd93af-ce33-4f33-8fba-feceff3ccee3', 'ef4b931b-e005-4099-a2f7-bdea1066a06f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:27 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:28 devstack sudo[91866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:28 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:28 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba" returned: 0 in 0.574s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:28 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba Apr 24 19:26:28 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:28 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.489s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Deleted volume successfully. Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-e2ab9a7e-97a6-429f-bfce-c3281c014640 tempest-VolumeDependencyTests-1446922614 None] Lock "cinder-d9500b24-493f-4ac8-8233-146db645491a-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:28 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588.4e7ca865-62a9-4e78-97e5-3927833bf7ba" returned: 0 in 0.442s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-quobyte-4e7ca865-62a9-4e78-97e5-3927833bf7ba" released by "_delete_snapshot" :: held 2.350s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-quobyte-3333a9fd-ddc2-41ab-867b-9fec9dcea588" released by "delete_snapshot" :: held 2.375s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Created reservations ['eefa60fc-ecab-4f69-8043-20bad4214d61', '4bd0368a-6248-4437-bddc-5eb0a0285d90', 'dca14e82-0ff0-48a0-994d-c1954b0b3953', 'd83162f8-51ac-4460-b588-675b491942da'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:28 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Delete snapshot completed successfully. Apr 24 19:26:28 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-17ea2be6-7a2b-49be-b137-4eddf92585b6 tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-4e7ca865-62a9-4e78-97e5-3927833bf7ba-delete_snapshot" released by "delete_snapshot" :: held 2.522s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "cinder-3333a9fd-ddc2-41ab-867b-9fec9dcea588-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-3333a9fd-ddc2-41ab-867b-9fec9dcea588-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "cinder-quobyte-3333a9fd-ddc2-41ab-867b-9fec9dcea588" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:29 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-quobyte-3333a9fd-ddc2-41ab-867b-9fec9dcea588" acquired by "delete_volume" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:29 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[0574a325-b9b1-44f5-bff9-f5d053145253]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:29 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:29 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 Apr 24 19:26:29 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:30 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588" returned: 0 in 0.639s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:30 devstack sudo[91881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588 Apr 24 19:26:30 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:30 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-3333a9fd-ddc2-41ab-867b-9fec9dcea588" returned: 0 in 0.462s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:30 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-quobyte-3333a9fd-ddc2-41ab-867b-9fec9dcea588" released by "delete_volume" :: held 1.181s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:30 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Created reservations ['a8766ed1-192d-44d0-bf4b-c06e2b6e99c5', '5932381f-fcc1-41ec-8430-7763acff20db', 'b8b1c196-48a5-429b-8c28-dc7f10c5fc97', 'd6ddf095-9733-4a3f-8ab4-c1a66eeeb631'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:30 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:30 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:30 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:30 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:31 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.420s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:31 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:31 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Deleted volume successfully. Apr 24 19:26:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-c6434b64-5193-47dd-a52e-445acca199af tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-3333a9fd-ddc2-41ab-867b-9fec9dcea588-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "cinder-12632909-b35f-483a-94fa-b9ee1971faa7-delete_volume" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-12632909-b35f-483a-94fa-b9ee1971faa7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "cinder-quobyte-12632909-b35f-483a-94fa-b9ee1971faa7" by "delete_volume" {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 19:26:31 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-quobyte-12632909-b35f-483a-94fa-b9ee1971faa7" acquired by "delete_volume" :: waited 0.020s {{(pid=82057) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 19:26:31 devstack cinder-volume[82057]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeb2b90-5fba-4afe-9b50-3040e012c8fd]: (4, 'qcow2') {{(pid=82622) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 19:26:31 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:31 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7 Apr 24 19:26:31 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:32 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7" returned: 0 in 0.503s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7 {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:32 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7 Apr 24 19:26:32 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:32 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc/volume-12632909-b35f-483a-94fa-b9ee1971faa7" returned: 0 in 0.423s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:32 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-quobyte-12632909-b35f-483a-94fa-b9ee1971faa7" released by "delete_volume" :: held 0.965s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:32 devstack cinder-volume[82057]: DEBUG cinder.quota [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Created reservations ['8276defd-4ae7-4e21-b6ee-bb77af0a0695', '4ef849e4-17dc-47fd-bd26-1c4117ead379', 'd6eca3f0-1b5d-48e1-be38-60c9fad842af', 'dc92fc26-997a-4e2d-a744-83723da1db6f'] {{(pid=82057) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 19:26:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 19:26:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 19:26:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596': None} {{(pid=82057) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 19:26:32 devstack cinder-volume[82057]: DEBUG cinder.volume.drivers.quobyte [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f320a8b0-3e66-4e61-b360-2ee5a6d52596'] {{(pid=82057) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 19:26:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.lockutils [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82057) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 19:26:32 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 19:26:32 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc Apr 24 19:26:32 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 19:26:33 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Apr 24 19:26:33 devstack cinder-volume[82057]: DEBUG oslo_concurrency.processutils [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/65e40bde15cbddfa6478001c65aef3fc" returned: 0 in 0.429s {{(pid=82057) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 19:26:33 devstack cinder-volume[82057]: DEBUG cinder.manager [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Notifying Schedulers of capabilities ... {{(pid=82057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 19:26:33 devstack cinder-volume[82057]: INFO cinder.volume.manager [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Deleted volume successfully. Apr 24 19:26:33 devstack cinder-volume[82057]: DEBUG cinder.coordination [None req-a53b2239-4dfe-4c35-b330-b2dc72d12692 tempest-CinderUnicodeTest-1826867387 None] Lock "cinder-12632909-b35f-483a-94fa-b9ee1971faa7-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82057) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 19:26:42 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:INSERT=32,cinder:UPDATE=115,cinder:SELECT=65,cinder:DELETE=5 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 19:26:43 devstack cinder-volume[82057]: DEBUG dbcounter [-] [82057] Writing DB stats cinder:UPDATE=130,cinder:SELECT=97,cinder:INSERT=32,cinder:DELETE=15 {{(pid=82057) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}